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About This Guide 


This guide describes how to use NetWare* Web Search Server to add search functionality to your 
Internet or Intranet Web site. It is intended for use by anyone involved in installing, managing, and 
using NetWare Web Search Server to create search services. It is divided into the following 
sections: 


+ Chapter 1, “Overview: NetWare Web Search Server,” on page 11 

+ Chapter 2, “What's New,” on page 17 

+ Chapter 3, “Installation and Configuration,” on page 21 

+ Chapter 4, “Designing Your Search Solution,” on page 41 

+ Chapter 6, “Creating and Managing Virtual Search Servers,” on page 57 

+ Chapter 5, “Optimizing Search Results,” on page 45 

+ Chapter 7, “Understanding Templates,” on page 81 

+ Chapter 9, “Customizing Your Search Solutions,” on page 113 

+ Chapter 8, “Working with Template Variables and Search Parameters,” on page 87 
¢ Chapter 10, “Internationalizing Search Services,” on page 117 

+ Appendix A, “Troubleshooting NetWare Web Search,” on page 125 

+ Appendix B, “Combined Character Sets for Use with NetWare Web Search,” on page 127 


Documentation Conventions 


In this documentation, a greater-than symbol (>) is used to separate actions within a step and items 
within a cross-reference path. 


A trademark symbol a TM, etc.) denotes a Novell trademark. An asterisk (*) denotes a third-party 
trademark. 


When a single pathname can be written with a backslash for some platforms or a forward slash for 
other platforms, the pathname is presented with a backslash. Users of platforms that require a 
forward slash, such as UNIX*, should use forward slashes as required by your software. 


IMPORTANT: In prior versions of NetWare® Web Search Server, the term search site was defined as a 
collection of one or more indexes and related configuration files. To avoid confusion with the term Web site, 
the term was changed wherever it appeared in the documentation and in the variables and parameters. Search 
site is now referred to as virtual search server. 


New variables and parameters that parallel the term virtual search server have been added. Note that they 
function identically to the prior variables and parameters, and that the old variables and parameters can still 
be used. 


Similarly, the term collection has been changed to index. 


We recommend that you start using the newer variables and parameters so as to avoid confusion. 
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Benefits 


Overview: NetWare Web Search Server 


NetWare® Web Search Server lets you add search and print functionality to any Web site, 
anywhere on the World Wide Web or on a company intranet. You can use it on your own 
enterprise-wide Web site or to host search services for business partners or clients. 


(1) User enters 


search query on 
www.digitalairlines.com. 


Search is sent to 
search.digitalairlines.com 
which is hosted by 

@ Web Search Server. 


O Web Search Server 
sends search results list 
to user. 


(4) User clicks a search 
result to retrieve 
documents from 
www. digitalairlines.com. 


This overview includes the following sections: 
+ “Benefits” on page 12 
+ “Features” on page 12 
+ “Key Components of Web Search” on page 13 
+ “Managing Web Search” on page 14 
+ “Taking a Test Run: Performing a Search” on page 15 
+ “Getting Help” on page 16 
+ “What's Next” on page 16 


More than 70% of Web site visitors on the World Wide Web use the search functionality of the 


Web sites they visit. Yet more than 50% of large Web sites (over 500,000 pages) and 70% of 


moderately sized Web sites (up to 5,000 pages) do not offer search functionality to their visitors. 
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Features 


And although Internet search engines index many of these Web sites, they either cannot or do not 
index all available content. 


The top two reasons given by Web site owners for not offering search functionality are difficulty 
in setting up a search service, and the length of time involved to do so. 


NetWare Web Search Server is easy to set up and manage, and is included free with NetWare 6.5. 
It includes a browser-based administration utility that includes helpful examples and tips right in 
the interface. The help system offers additional information and provides links to relevant topics 
in this manual. And unlike other search engines available on the market today, there are no 
escalated fees or limits on the number of documents indexed, the number of users who use the 
service, or the number of user transactions. 


Additionally, NetWare Web Search Server enables you to 
¢ Host search services for one or more companies or organizations 


+ Gather customer metrics by reviewing customer searches to identify what your customers 
look for the most 


¢ Direct customers to the information you know they need and away from the information you 
know they don't want 


¢ Spotlight products for marketing purposes by redirecting searches to specific Web pages 
+ Keep customers on your site longer 


+ Improve employee productivity by helping them find information more quickly 


NetWare Web Search Server offers many features for both the administrator and end user. 


Web Search Administrators 


Many new features and enhancements have been added to this latest release of Web Search, 
making the creation and management of search services faster and easier. If you are a veteran of 
Web Search, see “What's New” on page 17 for a list of the latest features. If you are new to Web 
Search, take a look at how you can use Web Search to 


+ Customize the look and feel of search and print results in all languages 


+ Create themes, which are defined collections of search and print result templates that allow 
you to deploy custom look and feel virtual search servers, each for a specific company or 
department 


+ Update your search indexes automatically using the Scheduling page 


¢ Synchronize indexes, templates, and configuration settings of two or more Web Search 
servers 


¢ Redirect searches for common products or terms to a specific URL 
+ Highlight search terms in the context of search result documents 


+ Improve search results by defining a list of words that Web Search should ignore while 
searching (such as and, or, and the) 


+ Have Web Search notify you by e-mail when there are errors during the indexing process 
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End Users 


End users, or users who use your search services, benefit from fast and accurate searches and the 
ability to print formatted search results. Additionally, end users can 


+ Search across multiple Web sites, servers, and file formats in any language, all from a single 
interface 


¢ Print large collections of dispersed but related files as a single, coherently organized document 


+ Use the new Highlighter feature to highlight search terms within the context of their original 
documents 


+ Narrow searches using common operators, switches, and wildcards 

+ Specify a date range and the level of detail they want returned in the search results list 
+ Choose which index to search 

+ Select the language Web Search should use when returning search results 


¢ Sort search results by title, description, language, date, or URL 


Key Components of Web Search 


Three key components are at the heart of the NetWare Web Search Server: virtual search servers, 
indexes, and templates. To understand how Web Search operates, you have to understand these 
components. 


Virtual Search Servers 


A virtual search server is a collection of HTML templates and supporting data files and consists 
of the following components: 


+ A name and alias, which appears in your list of virtual search servers 

+ Index files containing key words and related URLs for use in generating search results 
+ Scheduled indexing events 

+ HTML-based templates for highlighter, search, and print results 

+ Log files 


Each of these components are managed through the NetWare Web Search Manager, which is 
accessed using a Web browser (see “Managing Web Search” on page 14). 


Virtual search servers provide a method for categorizing similar information stores where each 
virtual search server is created for a specific purpose and audience. For example, you might create 
one virtual search server for your company’s support organization, another for its public Web site, 
and yet another for your intranet. You might break these down even further by creating more 
focused virtual search servers for groups within these organizations. 


A typical Web Search server might have a dozen virtual search servers, each containing several 
indexes of its own. 
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Indexes 


Templates 


search.novell.com 
indexes 
e index 1 
e index 2 
e index 3 
e index 4 


search. digitalairlines.com 
indexes 
e index 1 
e index 2 
e index 3 


search.mysql.com 
indexes 
e index 1 
e index 2 


TIP: If you want two or more virtual search servers to share an index, create a duplicate index on each virtual 
search server that points to the same index directory. In this manner, all virtual search servers can search a 
shared index in addition to their own indexes. 


An index is a file generated by NetWare Web Search Server that contains the key words and 
matching URLs gathered by Web Search from content located on file or Web servers. Web Search 
uses indexes to compile search results. You create one or more indexes for each virtual search 
server you create. 


You can create two types of indexes: file system and crawled. When you want to index the contents 
of a NetWare file server, you create a file system index. When you want to index the contents of a 
Web server, you create a crawled index. (For more information about creating indexes, see 
“Creating Indexes” on page 69.) 


To create virtual search servers and generate indexes for them, you use the NetWare Web Search 
Manager, a browser-based utility. 


A template is an HTML document containing one or more Web Search server variables. Template 
variables are used to produce dynamic results when a user performs a search on the virtual search 
server you have defined. 


Templates can be shared across virtual search servers or each virtual search server can point to its 
own set of templates. 


For more information about templates, see Chapter 7, “Understanding Templates,” on page 81. 


Managing Web Search 


NetWare Web Search Manager is a browser-based utility you use to create and manage all virtual 
search servers and their indexes on your Web Search server. 
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A NetWare@ Web Search Manager - Microsoft Internet Explorer 
File Edit View Favorites Tools Help 


Q back + 5- (dla A Search 37 Favorites @ Media © 


: Address ja https: //pac-land.provo.novell.com:2200/NSearch/AdminServlet be a Go Links 


NetWaree Web Search Manager 
Global Settings E 


Virtual Search Servers Virtual Search Server Management 


List Welcome to NetWare® Web Search Manager, the web-based administration tool for managing Web Search solutions. [More 
Add About Web Search Manager) 


Default Settings Virtual Search Server List 
General The virtual search server list shows all currently defined search servers. Start by creating a new virtual search 
Sena server or by managing one from the following list. [More About the Virtual Search Server List] 


Print 
[Name CTA O EE 
Index 


eae www.digitalairlines.com 137.65.67.132  SYS:\NSearch\sites\www. digitalairlines.com | Manage 


search.novell.com 123.456.543.210 SYS:\NSearch\sites\search novell.com [ Manage | 
Services Settings pac-land.provo.novell.com 137.65.47.216 SYS: /NSearch/sites/default Manage 
General 
Print 
Synchronization 


B @ internet 


Web Search Manager lets you apply default (global) settings so that each time you create a virtual 
search server, you don’t have to waste time configuring it. Once you create a virtual search server, 
you can override any of the default settings. 


See “Getting Help” on page 16 for more information about where to get help using NetWare Web 
Search Manager. 


Accessing NetWare Web Search Manager 


1 Typehttps: //domainname: portnumber in your Web browser’s address field, where 
portnumber is the port number of the NetWare Administrator’s NetWare 6.5 Welcome page, 
which by default is port 2200. 


You can also use the IP address of your server in place of a domain name. 


TIP: You must use the HTTPS protocol because NetWare Web Search Manager uses Secure Sockets 
Layer (SSL). You can disable encryption from the Admin Preferences page of the Apache Manager. See 


“Managing Apache Web Server Preferences” in the Apache Web Server Administration Guide for 
NetWare 6.5. 


2 Press Enter. 


3 Under NetWare Web Search Server, click the servername link, where servername is the name 
of your NetWare Web Search Server. 


Taking a Test Run: Performing a Search 


When you install NetWare Web Search Server, some of your server’s content is automatically 
indexed and appears on the default search form as "NetWare Web Search" and "DocRoot" indexes. 
The first is a file system index and the second is a crawled index. 


Once you have installed NetWare 6.5 with NetWare Web Search Server and the server has been 


started, you can open the search page using your Web browser and perform a search against the 
content that has been automatically indexed. 
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Getting Help 


What’s Next 
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To test NetWare Web Search using the default search page, do the following: 


1. Type http: //domainname/novellsearch in your Web browser’s address field and 
press Enter. 


IMPORTANT: The URL is case sensitive. Use the exact case shown above. You can substitute a domain 
name with your server’s IP address. 


2. Type NetWare in the Search field and press Enter. 


TIP: The Search form template, SearchTemplate.html, is stored on your server at lsearchroof Templates 
where \searchroot is the name of the folder where you installed Web Search. By default, this folder is found at 
sys:\NSearch found at the root of your sys volume. See “Customizing Your Search Solutions” on page 113 for 
information. 


The Web Search Manager interface includes tips, examples, and links into the Web Search help 
system. So whether you’re an expert or a novice Web Search administrator, you can get as much 
or as little information as you need, when you need it. 


When you need help using NetWare Web Search Manager, click one of the More About links found 
in some areas of the interface or click LA to launch the help system. The help system contains 
information about each item on the current Web Search Manager page. At the bottom of each help 
topic is the More Help On the Web section containing links into this NetWare Web Search Server 
Administration Guide. 


If the content of this manual does not answer your questions, please click [+] feedback in the upper 
right-hand corner of the document you are viewing. The information you provide is sent to the 
authors of this guide. Feedback is reviewed regular and the document is updated periodically. 


¢ Ifyou have not already installed Web Search, see Chapter 3, “Installation and Configuration,” 
on page 21. 


+ To learn more about preliminary steps to setting up an optimized search solution, see Chapter 
4, “Designing Your Search Solution,” on page 41. 


+ Once Web Search is installed and running, it takes only minutes to create your own virtual 
search server. For details, see Chapter 6, “Creating and Managing Virtual Search Servers,” on 
page 57. 
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What’s New 


Since NetWare® 6, NetWare Web Search Server has been significantly enhanced with new features 
that speed up search results, improve the accuracy of search results, and enhance the experience 
users have while searching. 


And as an administrator, you’ ll find improvements in performance and in the NetWare Web Search 
Manager interface. 


The following list highlights new features and enhancements to NetWare Web Search Server 
included with NetWare 6.5: 


+ 


Index Password Protected and HTTPS-Based Web Sites: By entering proper credentials into 
Web Search Manager, you can now index password protected and HTTPS-based Web sites. 
Web Search automatically sends authentication information to the Web sites you specify and 
then indexes the Web site’s content. (See “Creating Indexes” on page 69.) 


Index Remote File Servers: When used with the Novell® NFS* Gateway product, Web Search 
can index remote file servers. (See “Creating Indexes” on page 69.) 


Best Bets: Helps users find what they are looking for more quickly by bringing the most 
popular or most important results to the top of the results page. Best bets appears as a 
secondary search results list on the search results page. As an administrator, you control the 
results that appear in the best bets list by creating a customized best bets index. 


Search Within Searches: Lets users perform a second search from within the results of an 
original search. No configuration is required. This feature appears automatically on the search 
form. 


Search Terms Highlighter: Highlights the search terms and phrases wherever they appear in 
the actual documents found during the search without affecting the formatting of the original 
documents. As an administrator, you can specify characteristics of the highlighting, including 
the markup color. Search terms found in hidden document summary fields and META tags are 
also highlighted. (See “Configuring Search Settings” on page 63.) 


Synonym Enhanced Searches: When enabled, this feature helps customers find the 
information they are looking for even when they don’t know the correct terminology to use. 
By default, synonyms are less important than the original search term. But as a Web Search 
administrator, you can control the relevance of synonyms. A set of default synonyms are 
included, but you can create additional synonyms or delete existing ones. (See “Using 
Synonyms to Broaden Search Results” on page 50.) 


URL Redirection: Lets you specify key search terms that redirect the user’s Web browser to a 
specific URL. For example, searching for one net on Novell.com redirects your browser to a 
special page designed to emphasize Novell’s One Net strategy, rather than returning results on 
the search results page. (“Redirecting Searches” on page 51.) 


Search Expansion: If Web Search cannot locate any documents matching a user’s search 
query, a Not Found message is returned to the user. When you enable the search expansion 
feature, Web Search directs failed searches to additional indexes that you create for use with 
expanded searches. (See “Helping Users Avoid Failed Searches” on page 52.) 
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What’s Next 


+ 


Query Log Reporting: Query logging captures many details about user queries, including total 
number of searches performed (for the current logging period), top 100 search terms, load 
statistics, and the number of print jobs performed. This information can be used to improve 
the performance of your search services, or to identify areas of your site that could be 
improved. (See “Reviewing Query Log Reports” on page 45.) 


Stop Words: Although invisible to the user, this feature significantly improves search times by 
ignoring insignificant search words, such as conjunctions. For example, removing the word 
to from a user’s query can reduce the average query time from 1.7 seconds to 1.08 (a 40% 
improvement). A set of common stop words are included, but you can easily add your own, 
or remove one or more of the stop words included by default. (See “Using Stop Words 
Processing to Improve Search Speed” on page 49.) 


Web Search Synchronization: Lets you designate one Web Search server as the search master 
from which updated indexes, templates, and configuration settings are systematically sent out 
to all other Web Search servers defined as part of a Web Search Synchronization cluster. This 
saves system resources on all other machines because they do not have to regenerate indexes 
themselves. It also lets an administrator manage all other Web Search servers from a single 
interface. (See “Synchronizing Data Across Multiple Web Search Servers” on page 35.) 


Support for Robots.txt Exclusion Standard: Web Search now supports the Robots META tag, 
which contains instructions for search engines regarding what should and should not be 
indexed. By placing this tag in the documents you index, you can exclude them from being 
indexed or specify whether or not hypertext links contained in a document should be crawled. 
(See “Improving Search Results through Intelligent Indexing” on page 46.) 


E-mail Notification: Notifies administrators through e-mail about issues such as index failure, 
outdated indexes, or errors associated with Web Search Synchronization. For instructions 
about how to enable e-mail notification, see “Configuring Services Settings” on page 31. 


Product Update Notification: You can configure Web Search to automatically notify you as 
new software updates become available. A hypertext link to the URL where the updated can 
be downloaded appears on the General Services page of Web Search’s Global Settings. (See 
“Updating Web Search Server Software” on page 39.) 


Enhanced Access Management: In NetWare 6, Web Search depended on Enterprise Web 
Server NLM™ applications to authorize each search result for a particular user. Web Search 
now uses Novell eDirectory™ and the file system when authorizing access to individual 
search results. Web Search also allows user privileges to entire indexes, which provides 
rights-controlled access to crawled indexes and improves the overall speed at which search 
results requiring authentication are returned to the user. (See “Restricting Search Results to 
Specific Areas” on page 69.) 


Better Installation Program: NetWare Web Search Server is included as a pre-configured 
server option, letting you set up a NetWare server as a dedicated NetWare Web Search Server. 
(See Chapter 3, “Installation and Configuration,” on page 21). 


For information about installing Web Search, see Chapter 3, “Installation and Configuration,” 
on page 21. 


For information about designing a search solution, see Chapter 4, “Designing Your Search 
Solution,” on page 41. 


For more information about the Web Search product, visit the Web Search Product Page (http:/ 
/www.novell.com/products/websearch). 


18 NetWare 6.5 Web Search Server Administration Guide 


Whats New 19 


20 NetWare 6.5 Web Search Server Administration Guide 


Installation and Configuration 


You can install Web Search Server as a service on your NetWare® 6.5 server, or you can dedicate 
a server to it using the Pre-Configured Server install option. Once installed, you can modify the 
global settings of your new Web Search server. Global settings make the creation of new virtual 
search servers easier by letting you specify the default settings to be used each time you create one. 
You can also enable or disable certain features, such as best bets or Web Search Synchronization. 


This chapter includes the following sections: 
+ “Installing NetWare Web Search Server” on page 21 
+ “Configuring NetWare Web Search Server” on page 22 
+ “Configuring Default Settings” on page 24 
+ “Configuring Services Settings” on page 31 
+ “Synchronizing Data Across Multiple Web Search Servers” on page 35 
+ “Setting Up a Search Server to Receive Updates” on page 36 
+ “Setting Up a Search Master and Defining a Cluster” on page 37 
¢ “Setting Up a Virtual Search Server to Send Updates” on page 39 
¢ “Sending Synchronization Updates Manually” on page 39 
+ “About Using Web Search with Novell Cluster Services” on page 39 
+ “About Using Web Search with Novell Cluster Services” on page 39 
+ “Updating Web Search Server Software” on page 39 
+ “What's Next” on page 40 


Installing NetWare Web Search Server 


If you want to dedicate a server to hosting search services, select the NetWare Web Search Server 
from the Pre-Configured Server install options section while installing NetWare 6.5. When you 
select NetWare Web Search as your Pre-Configured Server, the Apache Web server and Tomcat 
servlet container are included. 


For more information about the NetWare 6.5 install process, see the NetWare 6.5 Overview and 
Installation Guide. 


If you did not install NetWare Web Search Server during the NetWare 6.5 installation, you can 
install it at anytime from the NetWare 6.5 Products CD. 
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Configuring 


To install NetWare Web Search Server from the NetWare 6.5 Products CD: 


1 Insert the NetWare 6.5 Products CD into the drive of the server where you want to install Web 
Search. 


2 Type startx at the system console and press Enter to start the NetWare GUI. 
3 Click Novell > Install > Add. 


4 Inthe Source Path dialog box, enter the path to the CD, or click the Browse button and locate 
the CD. 


Select the POSTINST.NI response file and click OK. 

From the products list, select NetWare Web Search Server. 

Click Next. 

When prompted, enter your administrator username and password, and your user context. 


Click OK. 


oaoana 0 


10 Follow the remaining screen prompts. 


IMPORTANT: After the installation is complete, you must restart the NetWare server. Type restart server 
at the system console. 


For instructions about accessing the Web Search Server Manager, the user interface for 
configuring and managing Web Search, see “Accessing NetWare Web Search Manager” on 
page 15. 


IMPORTANT: If you are upgrading from a previous version of Web Search Server, you must regenerate any 
older indexes before they can be searched. 


NetWare Web Search Server 


Before you start creating virtual search servers and building indexes for them, you might want to 
modify the global settings of your search server, which affect all virtual search servers you create. 


NetWare Web Search Manager’s home page displays a list of all virtual search servers that exist 

on your Web Search server (see Figure 1). This home page is called Global Settings because the 

changes you make from this page affect all new virtual search servers that you create, and they also 
affect the functionality of the search and print servlets that provide the Web Search services. 
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Figure 1 NetWare Web Search Manager’s Home Page 
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The Difference between Default and Services Settings 


Default Settings 


Services Settings 


The Global Settings page—also called the home page because it is the default page that appears 
when you first log in to Web Search Manager—s for use by the global search administrator, or the 
person who has administrative rights over the Web Search server. 


On the Global Settings page are two groups of settings: Default Settings and Services Settings. The 
first lets you specify default settings for new virtual search servers, and the second gives you 
administrative control of all virtual search servers. 


As the name implies, Default Settings lets you specify what the default settings should be each 
time you create a new virtual search server. For example, if you set the default query encoding 
from the General Settings page to Unicode (UTF-8), any new virtual search server you create after 
making this change defaults to the new setting. However, once you create a new virtual search 
server, you can then change its default settings. 


For more information, see Chapter 6, “Creating and Managing Virtual Search Servers,” on 
page 57. 


Services Settings lets you control all new and existing virtual search servers. For example, when 
you disable a feature such as e-mail services, the e-mail services feature is removed from the 
virtual search server configuration pages, making it impossible for the virtual search server 
administrator to access it. 


You can also perform other administrative tasks such as checking for software updates and 
configuring Web Search synchronization. 
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Configuring Default Settings 


Default Settings are meant to make the creation of new virtual search servers easier. By letting you 
specify common settings for use by all new virtual search servers, you don’t have to waste time 
making the same configuration changes each time you create a new virtual search server. 


Before you begin making changes, start by exploring Web Search so that you can decide what the 
most common configuration settings should be for your situation. You might start by planning your 
search solution to get ideas about the purpose for it, who will be using it, what languages it must 
support, and so on. For additional information about planning your search solution before you 
begin creating it, see Chapter 4, “Designing Your Search Solution,” on page 41. 
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General Settings lets you modify general query, response, error log, and e-mail settings. 
Remember that existing virtual search servers are not affected by these changes. 
To modify query settings: 

1 From Web Search Manager’s Global Settings page, click General under Default Settings. 


2 From the Default Query Encoding drop-down list, select an encoding that represents the 
character set encoding that the users of your search services are most likely to use. 


UTFS is a good choice for most situations since it works for all languages. For more 
information about character sets, see Appendix B, “Combined Character Sets for Use with 
NetWare Web Search,” on page 127. 


3 In the Maximum Query Duration field, enter the maximum number of seconds before Web 
Search should end a query, regardless of whether a search has been completed. 


This option is one of several methods that enable you to protect your server’s resources from 
processing rogue searches, which are sometimes intended to harm your service by consuming 
server resources. 


4 (Optional) Click Yes next to Enable Stop-words Processing if you want Web Search to ignore 
insignificant words, such as adverbs, conjunctions, or prepositions, in a user's search query. 


For information about stop words and how to edit the default list of stop words, see “Using 
Stop Words Processing to Improve Search Speed” on page 49. 


5 (Optional) Click Yes next to Enable Synonym Enhanced Search Results if you want Web 
search to expand search queries by looking for synonyms of the original search terms. 


For more information about synonym enhanced searches, see “Using Synonyms to Broaden 
Search Results” on page 50. 


6 Click Apply Settings. 


To modify response settings: 


41 Under Response Settings, select an output encoding from the Default Encoding for Response 
Pages drop-down list. 


This setting specifies the encoding Web Search should use when responding to user queries 
using the search and print results templates, and the error and response messages templates. 


2 Enter the maximum number of potential search results (hits) in the Refuse Queries if Potential 
Hits Exceed field that Web Search allows before cancelling the search. 
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TIP: A potential hit refers to all initial occurrences of a user’s search terms in an index. Once all matches 
between search terms and their related documents are found in the index, filters are applied to narrow 
the list of search results. Determining a user's access rights to individual files when performing a rights- 
based search is an example of a filter. 


If a search term is too vague, it can produce an inordinately large list of potential hits, which can place an 
unnecessary burden on your server. By limiting the number of potential hits allowed, you can reduce the 
processing overhead that would otherwise be placed on your server. If a user’s search query produces a 
number of potential hits that exceed the number you specify, a message is returned to them suggesting 
that they be more specific in their search query. 


While a hit might be found in the index, it might not yet be authorized by Novell® 
eDirectory™ and the File System to determine access rights. The number you specify here is 
critical in situations where a user may have access to only a few documents in an index that 
contains thousands of files. 


3 Click Apply Settings. 


To modify error log settings: 


1 In the Maximum Log Size field, enter the maximum size (in bytes) that Web Search should 
allow the log file to grow to. 


Depending on the number of visitors that your virtual search servers, log files can become 
large. This setting protects your system’s hard drive resources. 


TIP: The number you specify here is divided evenly between two log files. For example, if you specify 
30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


2 Click Apply Settings. 


To modify e-mail settings: 


1 (Optional) Click Yes next to Enable E-mail Services if you want Web Search to generate an 
e-mail message when errors occur during the generation (or regeneration) of your virtual 
search server's indexes, or when your indexes are being synchronized with other Web Search 
servers. 


IMPORTANT: If the E-mail Settings feature is not visible, you must enable it from the Services Settings 
> General page. See “Configuring General Services Settings” on page 31. 


2 (Optional) If you enabled e-mail services, type one or more e-mail addresses to which error 
messages should be sent. 


The addresses you enter here become default addresses for each virtual search server. They 
can be removed from within each virtual search server, or more addresses can be added. 
Separate each address using a space, comma, semicolon, or return. 


3 Click Apply Settings. 


Configuring Default Search Settings 
Default Search Settings lets you modify default search query, response, and template settings for 
all new virtual search servers. 
To modify search query settings: 
1 From Web Search Manager’s Global Settings page, click Search under Default Settings. 


2 (Optional) Under Query Settings, click Yes next to Enable Search Term Redirection if you 
want to redirect specific queries to specific URLs. 
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6 


For example, searching for one net on www.novell.com redirects your browser to a special 
page designed to emphasize Novell’s One Net strategy, rather than returning the search results 


page. 


TIP: For more information about other Web Search features you can use to improve the search service 
experience for your users, see Chapter 5, “Optimizing Search Results,” on page 45. 


(Optional) Click Yes next to Enable Best Bets Search Results if you want a specialized set of 
search results added to the top of the search results list. 


TIP: Best bets is another method of helping users find what they are looking for more quickly. For more 
information, see “Using Best Bets to Help Users Find the Right Information” on page 49. 


If you enabled best bets, click Yes next to Show Best Bets Searches By Default if you want 
the best bets results list always to appear on the search results page. 


Click No if you want users to request the best bets results list at the time of their search 
request. 


In the Maximum Number of Best Bets Results Per Page, type the maximum number of best 
bets results to be included per search results page. 


TIP: Consider keeping the list relatively short since the purpose of best bets is to narrow the search for 
users. 


Click Apply Settings. 


To modify search response settings: 


1 


3 


4 


5 


Under Response Settings, enter the number of search results in the Default Number of Results 
to Display field that you want included on search results pages. 


For example, if you set this to 25 (the default setting) and the number of hits in a return was 
200, Web Search would only return 25 hits per search results page. 


Set a limit on the number of results allowed at one time on the results page by entering a 
number in the Maximum Number of Results to Display field. 


TIP: Use this setting (and the Highest Allowed Result Number setting) to protect your server from users 
who might attempt to set the number of results excessively high in order to intentionally abuse your 
computer. This can be done using available query parameters such as &NumHits=number and 
&StartHit=number. This setting blocks the use of such parameters. 


Enter the highest number of search results that can be returned to a user query in the Highest 
Allowed Result Number field. 


(Optional) Click Yes next to Enable Search Terms Highlighter if you want users' search terms 
to be highlighted in the documents returned in a search. 


When the highlighter is enabled, a special icon appears on the search results page users can 
click to show highlighted words in context. For instructions about how to customize the colors 
used by the highlighter, refer to the next procedure. 


Click Apply Settings. 


To customize (or delete) highlighter color schemes: 


1 
2 


Under Response Settings, click Edit Colors next to Enable Search Terms Highlighter. 
Click the Color button in the Foreground and Background columns to select a color. 
or 


Type the color value (such as #RRGGBB) or color names. You can review your selections in 
the Preview column. 
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3 Ifyou want to define additional colors, click Add More Colors. 


TIP: Because a user can search for more than one search term at a time, you can define multiple colors 
so that each search term appears in a different color. For example, if a user searched for "HTTP AND 
Apache", the terms appear highlighted in the documents where they originated. The colors are used in 
the order in which they are defined here. 


4 To remove a defined color set, click Delete in the row of the color set you want removed. 


5 Click Apply Settings. 


To modify search template settings: 


1 Under Template Settings, enter a path to where your Web Search templates are stored in the 
Templates Directory field. 


TIP: The default path is volume:\searchroot\Templates, but if you have created custom templates or for 
some reason want to keep your templates elsewhere, specify the path here so that Web Search knows 
where the templates are. 


2 From the Default Encoding for Templates drop-down list, select the character set that your 
templates are written in. 


This value is used with templates that do not specify an encoding. Encodings found in 
templates that do not match the encoding you specify here overrides this encoding. 


3 Inthe Default Search Page Template field, enter the filename of the search page template you 
want to use. 


If you have created a custom template and want Web Search to use it as your search page, enter 
its name in this field. 


4 Inthe Default Search Results Template field, enter the filename of the search results template 
you want to use. 


As with the default search page template, if you have created a custom search results template 
and want Web Search to use it as your default search results page, enter its name in this field. 


5 In the Default Highlighter Template field, enter the filename of the highlighter template you 
want to use. 


As with the default search and results page templates, if you have created a custom highlighter 
template and want Web Search to use it as your default highlighter page, enter its name in this 
field. 


6 In the Template to Use If No Results Returned field, enter the filename of the template that 
Web Search should return if no results are found. 


7 Inthe Template to Use If Error Occurs field, enter the filename of the template that Web 
Search should return if there are errors while processing a user’s query. 


8 Click Apply Settings. 
For more information about Web Search templates, see Chapter 7, “Understanding Templates,” on 
page 81. 
Configuring Default Print Settings 


Default Print Settings lets you modify default print result, and print template settings for all new 
virtual search servers. 
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To modify default print result settings: 


1 
2 


From Web Search Manager’s Global Settings page, click Print under Default Settings. 


Under Print Results Settings, enter the number of print results in the Default Number of 
Results to Print field that you want displayed on each print results page. 


For example, if you set this to 25 (which is the default setting) and the number of hits in a 
return was 200, Web Search would only return 25 hits per print results page at a time. 


Set a limit on the number of results allowed at one time on the results page by entering a 
number in the Maximum Number of Results to Print field. 


Enter the highest number of search results that can be returned to a user query in the Highest 
Allowed Result Number field. 


To limit the size of a print job, specify the largest print job size that Web Search should allow 
in the Maximum Print Job Size field. 


Any users requesting a print job larger than this value receives a message informing them that 
their request was too large. 


TIP: This is a useful feature to administrators who want to keep down the size of print jobs in their own 
companies, departments, or organizations. 


To be notified when a print job exceeds a certain size, enter the print job size in the Print Job 
Size Warning field. 


By default, this message is sent using the ResponseMessageTemplate.html file and is intended 
as a warning to users that they are exceeding the allowed print job size. It then prompts the 
user to confirm the print job before continuing. 


To modify default print template settings: 


1 


6 


7 


Under Template Settings, enter a path in the Templates Directory field to where your Web 
Search templates are stored. 


TIP: The default path is volume:\searchroot\Templates, but if you have created custom templates or for 
some reason want to keep your templates elsewhere, specify the path here so that Web Search knows 
where the templates are. 


From the Default Encoding for Templates drop-down list, select the character set that your 
templates are written in. 


This value is used with templates that do not specify an encoding. Encodings found in 
templates that do not match the encoding you specify here overrides this encoding. 


In the Default Print Results Template field, enter the filename of the print results template you 
want to use. 


If you have created a custom print results template and want Web Search to use it when 
returning print results, enter its name in this field. 


In the Template to Use If No Results Returned field, enter the filename of the template that 
Web Search should return if no print results match a user’s query. 


In the Template to Use If More Information Is Needed field, enter the filename of the template 
to be sent back to users whose print jobs exceed the size you specify in the Print Job Size field. 
(See Step 6.) 


In the Template to Use If Error Occurs field, enter the filename of the template that Web 
Search should return if there are errors while processing a user’s print query. 


Click Apply Settings. 


NetWare 6.5 Web Search Server Administration Guide 


Configuring Default Index Settings 


These settings are intended to make the process of creating indexes even easier by letting you 
configure common settings as default settings. This saves you time by not making you make the 
same selections each time you create a new index. 


To modify default index settings: 


1 
2 
3 


10 


11 
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From Web Search Manager’s Global Settings page, click Print under Default Settings. 
Click Index under Default Settings. 


Select the type of index that you want as the default index type on the Indexing Management 
page. 

Each time you create a new index, the index type you select here will be automatically 
selected. Of course, you can select either index type when you create an index. 


Click Yes next to Obey Robots.txt Exclusions When Crawling to instruct Web Search to obey 
the instructions in the Robot.txt file as it indexes Web sites. 


For more information about Robots.txt, see “Using the Robots META Tag” on page 47. 


Click Yes next to Crawl Dynamic URLs (URLs Containing '?") if you want Web Search to 
index dynamic content, in addition to static content. 

TIP: Some search engines do not crawl Web pages that are created dynamically, such as pages 
generated from forms submitted by a Web browser. The URLs of dynamic content typically contain a 


question mark (?) followed by additional parameters. (See “About Indexing Dynamic Web Content” on 
page 77.) 


Because dynamic content can change at any time, you might want to schedule more frequent 
regeneration events for your indexes when enabling this feature. For information about scheduling 
automatic updates to your indexes, see “Automating Index and Server Maintenance” on page 78. 


Check the URLs Are Case Sensitive check box if you want Web Search to recognize URLs 
that are different only in character case, but are otherwise identical. For example, 
www.digitalairlines.com versus www.DigitalAirlines.com. 


IMPORTANT: By setting this option to No can help Web Search to avoid indexing duplicate information, 
which can come from indexing URLs that are presented using different cases but actually point to the 
same information. However, if a Web server being indexed is configured to differentiate between cases, 
Web Search might leave out content that you want indexed. 


In the Maximum Index Depth field, type the maximum number of hypertext links from the 
starting URL that Web Search should follow before it stops indexing. 


Enter a number (in bytes) in the Maximum File Size to Index field to keep Web Search from 
indexing files larger than the number you specify. 


In the Maximum Time to Download a URL field, enter a number (in seconds) before Web 
Search automatically skips the indexing of the specified URL. 


Type a number (in milliseconds) in the Delay Between URL Requests field that Web Search 
should pause between requests for URLs that it is trying to index. 


From the Encoding (If Not in META Tags) drop-down list, select the encoding to be used 
when indexing files that do not contain an encoding specification. 


For example, HTML files can specify their encoding with a Content-Type META tag. 
Click Apply Settings. 
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To allow indexes to be used with Web Search Synchronization: 


4 Under Synchronization Settings, click Yes next to Index May Be Copied To Other Clustered 
Servers. 


For more information about Web Search Synchronization, see “Synchronizing Data Across 
Multiple Web Search Servers” on page 35. 


2 Click Apply Settings. 


To enable or disable user authentication when accessing indexes: 


4 (Optional) Under Rights-Based Search Results, click Off to allow access to the indexes to 
anyone. 


No user authentication is required to search the indexes of the current virtual search server. 


2 (Optional) Under Rights-Based Search Results, click By Index to restrict access to the 
indexes only to those who have access rights to the filename you specify in the By Index text 
box. allow access to the indexes to anyone 


3 In the By Index text box, type the full path to a file on your server that already has rights 
protection assigned to it. 


For example, on a NetWare 6.5 server where Apache is your Web server, you might type 
sys:\\Apache2\htdocs\index.html. 


4 Select either Search Engine or Templates from the Unauthorized Hits Filtered By drop-down 
list to specify how Web Search should handle attempts to access indexes without 
authorization. 


+ Select Engine if you don’t want any search results displayed when users attempt to search 
the index without first logging in. A No Results Found message is returned instead. 


+ Select Template to have Web Search return search results to users who have not logged 
in. When they attempt to click a search result, they are then prompted for a username and 
password. 


TIP: You can use the $$BeginUnAuthorized and $$EndUnAuthorized template variables to control how 
the template should display unauthorized hits. For more information about template variables, see 
Chapter 8, “Working with Template Variables and Search Parameters,” on page 87. 


5 Click Apply Settings. 
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Security settings let you manage access to indexed content by requiring users to authenticate to a 
server before seeing rights-protected search results. The Security Settings page lets you configure 
rights-based search results and specify secure connection settings, including enabling the HTTPS 
protocol for securing usernames and passwords as they are sent over the network. 


To modify default rights-based search results: 


4 From Web Search Manager’s Global Settings page, click Security under Default Settings. 


2 In the Default Search Contexts text box, type the eDirectory context where user objects are 
stored. 


By entering a context here, users won't have to supply their fully-qualified user IDs when 
logging in to Web Search. For example, if your user objects are all kept in a container named 
employees, type employees in the Default Search Contexts box so that Web Search knows 
where to look when a user attempts to log in. A user whose fully qualified name is 
sjones.employees.marketing.digitalairlines would only have to enter sjones. 


NetWare 6.5 Web Search Server Administration Guide 


3 Click Yes next to Check Authorization By Directory if you want Web Search to validate user 
rights to files in a directory (search results) based on whether or not they have rights to any 
one file in the same directory. 


4 In the Authentication Realm String field, type the correct authentication realm string, which 
is typically shown in your Web browser's login dialog box. 


TIP: Specifying the Apache Web server's authentication realm string in this field makes it so that once 
users authenticate to it, they won't have to authenticate again when using Web Search to search and 
access protected information. 


TIP: If Apache is your Web server, refer to http://httpd.apache.org/docs-2.0/howto/auth.html (http:// 
httpd.apache.org/docs-2.0/howto/auth.html) for more information about authentication. 


5 Click Apply Settings. 


To modify default connection settings: 


4 Under Connection Settings, click Yes next to Require HTTPS if you want to protect 
usernames and passwords as they are sent across the network or Internet. 


2 Enter a number (in minutes) in the Auto-logout Time field to direct Web Search to log users 
out who have been idle for the specified period of time. 


3 Click Apply Settings. 


Configuring Services Settings 


Services Settings are meant for global Web Search server administrators, giving them global 
control of the Web Search server and all virtual search servers, including the ability to completely 
disable a virtual search server. Services Settings also let the administrator control the overall 
performance of the Web Search server. 


Unlike the Default Settings, changes made here affect both new and existing virtual search servers. 
For example, if the e-mail feature is enabled from the Default General Settings page (accessed 
from the Global Settings page), and on the General Settings page of a virtual search server, the 
global administrator can disable it from General Services Settings. When that is done, the e-mail 
feature is disabled and its settings are removed from all other configuration pages. 


Configuring General Services Settings 


General Services Settings let you configure product update, error log, and e-mail settings. If you 
disable a feature here, it is disabled on all virtual search servers and removed from their 
configuration pages. If you re-enable the feature, it reappears on all configuration pages with the 
same settings used before it was disabled by the global administrator. 
To modify product update settings: 

1 From Web Search Manager’s Global Settings page, click General under Services Settings. 


2 (Optional) Under Product Update Settings, click Yes next Check For Product Updates if you 
want Web Search to regularly check for software updates and notify you when updates are 
available. 


For more information, see “Updating Web Search Server Software” on page 39. 
3 To check for software updates immediately, click Check Now. 
4 (Optional) If you modified the Check For Product Updates option, click Apply Settings. 
5 Click Apply Settings. 
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To modify error log settings: 


1 


4 


Under Error Log Settings, select where you want log results displayed by choosing one of the 
following options from the Log Errors To drop-down list: 


+ File: When this option is selected, you can click View next to the Log Errors To drop- 
down list and the log results are displayed in your browser. 


+ Console: You can also view log results at the NetWare system console by selecting 
Console, pressing Ctrl+Esc on your server's keyboard, and then pressing the number 
corresponding to the Tomcat servlet engine. 


+ Both: Displays results in both your browser and at the system console. 
TIP: You can access the log file directly by going to volume:\\searchrootf\errors.log. 


To start a new log file each time you restart the Web Search server, click Yes next to New Log 
When Services Load. 


TIP: You can also delete the log file at the path specified above. The log file is recreated on the first 
instance of a new error, statistics, etc. 


To limit the size of the log file, enter a file size (in bytes) in the Maximum Log Size field. 


TIP: The number you specify here is divided evenly between two log files. For example, if you specify 
30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


Click Apply Settings. 


To modify e-mail settings: 


1 


6 


Under E-mail Settings, click Yes next to Enable E-mail Services if you want Web Search to 
generate an e-mail message whenever errors occur during the generation (or regeneration) of 
your virtual search server's indexes, or when your indexes are being synchronized with other 
Web Search servers. 


In the Outgoing SMTP Host Name field, type the SMTP host name of the mail server that 
handles e-mail requests. For example, mail.novell.com. 


In the Outgoing SMTP Port Number field, type the SMTP port number for the mail server 
specified above. Typically, the port number for mail servers is 25. 


(Optional) If your SMTP server requires authentication the, type your user ID in the Outgoing 
SMTP User ID field. 


(Optional) Type the matching password for your SMTP user account in the Outgoing SMTP 
Password field. 


Click Apply Settings. 


To modify server management settings: 


1 


Under Server Management Settings, type a number in the Maximum Number of Active Index 
Jobs field to limit the number of indexing jobs that can run simultaneously. 


Any indexing jobs beyond the number you specify here are placed in a queue until one of the 
original indexing jobs is completed. 


TIP: Because each server’s performance varies due to hardware configuration and the amount of user 
traffic, you should experiment with how many indexing jobs you can run simultaneously without negatively 
affecting the performance of your server. Also, you might consider regenerating indexes after business 

hours using the Index Scheduling feature. (See “Automating Index and Server Maintenance” on page 78.) 
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2 In the Default Location of Virtual Search Servers field, specify the path where you want all 
virtual search server files to be stored, including index and configuration files. 


TIP: Changing this setting won't move existing sites to the new default location. But all new virtual search 
servers will be placed here. 


3 To direct Web Search to reload configuration files modified manually, outside of Web Search 
Manager, click Yes next to the Detect Manual Search Server Changes field. 


If you make changes outside of Web Search Manager, such as modifying configuration or 
properties files or any of the template, Web Search re-reads those files as often as you indicate 
in the Seconds Between Checking for Changes field. 


TIP: If you modify the adminservlet.properties file, you must reboot your server in order for the changes 
to take effect. This is the only file that cannot be reread using the Detect Manual Search Server Changes 
feature. 


4 In the Seconds Between Checking for Changes field, specify how often Web Search should 
check for manual changes (changes made outside of Web Search Manager) to the 
configuration files. 


5 To direct Web Search to reload Web Search templates that have been modified, click Yes next 
to the Detect Template Changes field. 


After making a change to a template from within your HTML editing tool and saving it on 
your server, Web Search re-reads the template as often as you specify in the Seconds Between 
Template Updates field. That way you can test your changes almost immediately. 


6 Inthe Seconds Between Checking for Template Changes field, specify how often Web Search 
should reload search, print, results, and error templates. 


7 Click Apply Settings. 


Configuring Search Services Settings 


Search Services Settings let you turn search capabilities on or off and manage debugging and 
statistics settings. 
To modify general search services settings: 

4 From Web Search Manager’s Global Settings page, click Search under Services Settings. 


2 Under General Search Settings, click Yes next to Enable Search Service to enable search 
services for all virtual search servers on your Web Search server. 


3 To enable the highlighter, click Yes next to Enable Highlighter Service. 
4 Click Apply Settings. 


To modify search debug settings: 


1 Under Debug Settings, click Yes next to Enable Search Debugging if you want to keep a log 
of all searches and query results going to all virtual search servers. 


IMPORTANT: We recommend that you use this features only while setting up or troubleshooting your 
search services because depending on search activity, the log file can grow in size very quickly. In 
addition, logging query and response details can slow down searches. 


2 Select where you want log results displayed by choosing one of the following options from 
the Log Debug Messages To drop-down list: 


+ File: When this option is selected, you can click View next to the Log Debug Messages 
To drop-down list and the log results are displayed in your browser. 


Installation and Configuration 33 


+ Console: You can also view log results at the NetWare system console by selecting 
Console, pressing Ctrl+Esc on your server's keyboard, and then pressing the number 
corresponding to the Tomcat servlet engine. 


+ Both: Displays results in both your browser and at the system console. 


3 To start a new log file each time you restart the Web Search server, click Yes next to New Log 
When Services Load. 


4 To limit the size of the log file, enter a file size (in bytes) in the Maximum Log Size field. 


TIP: The number you specify here is divided evenly between two log files. For example, if you specify 
30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


To modify search statistics settings: 


1 Under Statistics Settings, click Yes next to Enable Search Statistics Logging if you want an 
updated log file containing statistics about searches performed against all virtual search 
servers on your Web Search server. 


2 In the Seconds Between Statistics Updates field, enter a number (in seconds) that should 
elapse between updates of the statistics log file. 


3 For the next three fields, follow Step 2, Step 3, and Step 4 from the previous procedure. 


4 In the Log Error If Search Time Exceeds field, enter a number (in seconds) before Web Search 
should record the current search as exceeding the specified time limit on the statistics display. 
This appears as the Limit portion of the statistics display. 


5 Click Apply Settings. 
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To modify general print services settings: 
1 From Web Search Manager’s Global Settings page, click Print under Services Settings. 


2 Under General Print Settings, click Yes next to Enable Print Service to enable print services 
for all virtual search servers on your Web Search server. 


3 Click Apply Settings. 


To modify print debug settings: 


41 Under Debug Settings, click Yes next to Enable Print Debugging if you want print debugging 
turned on. 


IMPORTANT: We recommend that you use this features only while setting up or troubleshooting your 
search services because depending on search activity, the log file can grow in size very quickly. In 
addition, logging query and response details can slow down searches. 


2 Select where you want log results displayed by choosing one of the following options from 
the Log Debug Messages To drop-down list: 


+ File: When this option is selected, you can click View next to the Log Debug Messages 
To drop-down list and the log results are displayed in your browser. 


+ Console: You can also view log results at the NetWare system console by selecting 
Console, pressing Ctrl+Esc on your server's keyboard, and then pressing the number 
corresponding to the Tomcat servlet engine. 


+ Both: Displays results in both your browser and at the system console. 
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3 To start a new log file each time you restart the Web Search server, click Yes next to New Log 
When Services Load. 


4 To limit the size of the log file, enter a file size (in bytes) in the Maximum Log Size field. 


TIP: The number you specify here is divided evenly between two log files. For example, if you specify 
30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


5 Click Apply Settings. 


To modify print statistics settings: 


1 Under Statistics Settings, click Yes next to Enable Print Statistics Logging if you want to an 
updated log file containing statistics about print requests performed on your Web Search 
server. 


2 In the Seconds between Statistics Updates field, enter a number (in seconds) that should 
elapse between updates of the statistics log file. 


3 For the next three fields, follow Step 2, Step 3, and Step 4 above. 


4 In the Log Error If Print Time Exceeds field, enter a number (in seconds) before Web Search 
should record the current print job as exceeding the specified time limit on the statistics 
display. This appears as the Limit portion of the statistics display. 


5 Click Apply Settings. 


Configuring Synchronization 


Web Search Synchronization lets you designate one Web Search server as the search master from 
which updated indexes, templates, and configuration settings are systematically sent out to all 
other Web Search servers defined as part of a Web Search Synchronization cluster. 


For more information about setting up and configuring Web Search Synchronization, see the next 
topic, Synchronizing Data Across Multiple Web Search Servers. 


Synchronizing Data Across Multiple Web Search Servers 


If you are running multiple installations of Web Search across several NetWare servers, you can 
simplify management tasks, such as re-generating indexes and sharing configuration settings, by 
configuring all of your servers into a single Web Search Synchronization cluster. 


Web Search Synchronization lets you designate one Web Search server as the search master from 
which updated indexes, templates, and configuration settings are systematically sent out to all 
other Web Search servers defined as part of a Web Search Synchronization cluster. Each of the 
other servers must be configured to receive updates from the search master. 


Web Search Synchronization offers several key benefits: 


+ Saves system resources on all other machines because they do not have to regenerate indexes 
themselves. 


+ Lets an administrator manage all other Web Search servers from a single interface. 


+ Regenerates indexes nightly on the search master and then pushes them out to all other Web 
Search servers. 
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¢ Offers fault tolerance and load-balancing benefits by hosting Web Search indexes, templates, 
and configuration settings across multiple servers; if one server goes down, your users will 
not know the difference. 


NOTE: You might want to use a Novell iChain® server to front the Web Search Synchronization cluster 
servers. This would offer basic load-balancing capabilities using revolving IP addresses. For more 
information, see the Novell ¡Chain Administration Guide (http://www.novell.com/documentation/lg/ 
ichain20/index.html). 


+ Ensures that all Web Search servers within a cluster are using the same version of an index. 
This means that you will never have a server that has a newer version of an index than all other 
servers. Even the search master won't use the newly generated indexes unless all of the servers 
in the cluster can also do so. 


IMPORTANT: Web Search Server Synchronization is different from Cluster Services. Novell Cluster 
Services™ groups two or more NetWare servers together for the sake of failover and for ensuring server 
availability. A Web Search Synchronization cluster synchronizes indexes, templates, and configuration 
settings between two or more Web Search servers, thus reducing the administrative work of updating the same 
index across several Web Search servers. (See “About Using Web Search with Novell Cluster Services” on 
page 39.) 


To enable Web Search Synchronization, you need to do the following: 


+ Configure each Web Search server and virtual search servers that you want included in the 
cluster to receive updates. 


+ Designate one of the Web Search servers as the search master and configure it to send updates 
to other Web Search servers by identifying each of the other servers to be included in the 
cluster. A search master can continue to serve as a Web Search server, and you can have more 
than one search master in your Web Search Synchronization cluster. 


+ Configure which indexes on the search master will be included in the synchronized cluster. 


Although the order in which you perform these tasks is not critical, we recommend that you set up 
the Search servers intended to receive cluster data first, and then configure a Web Search server as 
the search master and use it to define the synchronization cluster. 
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For each Web Search server you want included in a synchronization cluster, you must configure it 
to receive updates. Also, each virtual search server must be configured to receive updates. You 
must make the same changes on every server to be included in the cluster. 


To set up a Web Search server to receive cluster data: 


4 From the Global Settings page of Web Search Manager, click Synchronization under Services 
Settings. 


2 Under General Synchronization Settings, click No next to Will This Machine Send Cluster 
Data. 


3 Click Yes next to Will This Machine Receive Cluster Data. 


4 (Optional) Click Yes next to Require Admin Authorization When Receiving Cluster Data if 
you want to require incoming requests to provide administrator credentials before proceeding. 
TIP: If the risk of intrusion to your server is low—for example, if your server is behind a firewall—it is 


better to disable this feature by clicking No. Enabling it can slow down system performance because of 
the rights checking that happens each time a request to send cluster data is received by the server. 
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7 


(Optional) Click Yes next to Require HTTPS for All Cluster Communications to require a 
secure sockets layer (SSL) connection from a search master attempting to send updated data 
to this Search Server. 


In the Maximum Number of Transmission Attempts field, type the number of times Web 
Search should attempt to connect to other servers in a cluster. 


In the Number of Seconds Between Transmission Attempts field, type the number of seconds 
Web Search should wait between transmission attempts. 


You might want to set this number high enough to allow a server to fully restart after a failure. 


Click Apply. 


Once you have configured a Web Search server to receive data, you must also configure at least 
one virtual search server to receive updates. 


To set up a virtual search server to receive updates: 


1 
2 
3 


4 


From the Global Settings page, select a virtual search server from the list by clicking Manage. 
Under Settings, click Synchronization. 


Click Yes next to Let Virtual Search Server Receive Cluster Data (at the very bottom of the 
Synchronization Settings page). 


Click Apply Settings. 


Setting Up a Search Master and Defining a Cluster 


Once you have configured both the Web Search servers and virtual search servers for each server 
to be included in the Web Search Synchronization cluster, you now need to configure a search 
master and define one or more clusters. 


To set up a Web Search server to send updates: 


1 


2 


From the Global Settings page of Web Search Manager, click Synchronization under Services 
Settings. 


Under General Synchronization Settings, click Yes next to Will This Machine Send Cluster 
Data. 


Click No next to Will This Machine Receive Cluster Data. 


NOTE: If you want the search master to receive updates from another server in the cluster, select Yes. 
You can configure a Web Search server to both send and receive updates. 


Because this is the search master and will likely not be receiving cluster data, click No next 
to Require Admin Authorization When Receiving Cluster Data. 


(Optional) To ensure a secure connection with the other Web Search Servers, click Yes next 
to Require HTTPS for All Cluster Communications. 


TIP: If the risk of intrusion to your server is low—for example, if your server is behind a firewall—it is 
better to disable this feature by clicking No. Enabling it can slow down system performance because of 
the rights checking that happens each time a request to send cluster data is received by the server. 


In the Maximum Number of Transmission Attempts, enter the number of times the search 
master should attempt to transmit data to an unresponsive Web Search Server in the cluster 
before quitting. 


TIP: After the number of transmission attempts specified here is reached, Web Search stops trying to 
transmit data to other servers in a cluster. If the e-mail notification capability has been enabled, then Web 


Installation and Configuration 37 


38 


Search will also send an e-mail identifying the cause of the problem. For information about enabling the 
e-mail feature, see “Configuring Services Settings” on page 31. 


7 Inthe Number of Seconds Between Transmission Attempts, type the number of seconds Web 
Search should wait between each transmission attempt specified in the Maximum Number of 
Transmission Attempts. 


8 (Optional) Under Synchronization Logging Settings, click Yes next to Enable 
Synchronization Logging if you want Web Search to log cluster-related errors. 


9 (Optional) Click the Log Synchronization Messages To drop-down box to select where log 
data should be recorded. 


Select File if you want the data stored in a file on your server, or click Console if you want the 
data displayed on the NetWare system console. Select Both to have the date written to both a 
file and to the system console. You can also click View to see the latest log data in your Web 
browser. 


10 (Optional) Click Yes next to New Log When Synchronization Manager loads to start a new 
logging session when the synchronization manager servlet is loaded (or restarted). 


The contents of the current log are replaced with the new data. 


11 (Optional) In the Maximum Log Size (Bytes) field, enter the maximum file size of the log 
file before a new one is started. 


TIP: The number you specify here is divided evenly between two log files. For example, if you specify 
30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


To define a synchronization cluster: 


You must identify each of the Web Search Servers (and their virtual search servers) that you have 
configured to receive cluster data. To do so, you must know the URL of each server to be included, 
as well as the names of each virtual search server on each of the Web Search servers that you want 
included. 


Also, if you have configured any of the participating servers to require administrator authorization 
when being accessed by the search master, you must provide their administrator usernames and 
passwords. 


1 From the Global Settings page of Web Search Manager, click Synchronization under Services 
Settings. 


2 Under Defined Clusters, enter a name for the new cluster in the Cluster number Name field. 


3 Inthe Server number URL field, enter the URL to a Web Search Server that you want included 
in the cluster, and specify the name of the virtual search server to be included. 


4 In the Virtual Search Server field, type the name of a virtual search server. 


5 (Optional) If you enabled (or will enable) the Require Admin Authorization feature on this 
Web Search Server, enter the admin username and password in the appropriate fields. 


6 (Optional) To add another server to the cluster, click Add Server and repeat Step | through 
Step 5. 


7 Click Apply. 
8 To add additional clusters, click Add New Cluster. 
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Setting Up a Virtual Search Server to Send Updates 
The last step in setting up Web Search Synchronization is to configure one or more virtual search 
servers on your search master to send updates. 
1 From the Global Settings page, select a virtual search server from the list by clicking Manage. 
2 Under Settings, click Synchronization. 
Under Send Settings, click Yes next to Let Virtual Search Server Send Cluster Data. 
Click Edit next to the Under Name of Clusters To Send To field. 


Select one or more clusters that you have defined and click Apply. 


og bh Ww 


Select one or more indexes from Indexes to Send to Clusters. 


TIP: The indexes you select are sent to the designated clusters every time they are regenerated 
(manually or scheduled). Also, you can click the Indexes button under the Send Indexes section to send 
these indexes immediately to the clusters you've selected. 


7 Click Apply Settings. 


Sending Synchronization Updates Manually 


Once Web Search Synchronization is configured properly, you can go to a virtual search server and 
send index, template, and configuration updates at any time. For example, if you had to make a 
correction or addition to a template, you could open the Synchronization Settings page and click 
Templates under Send Now and the templates would then be pushed out to all other virtual search 
servers in the clusters you selected in the Name of Clusters to Send To field. 
To send synchronization updates manually: 
1 From the Global Settings page, select a virtual search server from the list by clicking Manage. 
2 Under Settings, click Synchronization. 


3 Under Send Now, click the Indexes, Templates, or Settings button to send updates from the 
current virtual search server to all others in the cluster. 


Once the process is underway, a confirmation page is returned. You don’t have to wait for the 
process to complete before you continuing to work in Web Search Manager. 


About Using Web Search with Novell Cluster Services 


Because Web Search Synchronization provides both a fault-tolerant and load-balanced 
environment, it is unnecessary to set up Novell Cluster Services (NCS) for use with Web Search. 
However, if you want to include failover capabilities, then you might consider using it. 


For information about using Web Search with NCS, see the Novell Cluster Services 1.7 Resource 
Configuration Guide. 


Updating Web Search Server Software 


As new Web Search software becomes available, you can be notified automatically from within 
Web Search Manager. 


When new software is available, a message appears on the Global Settings page with a link where 
you can download the latest version. 
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What’s Next 


+ Once you have installed and configured Web Search, you might want to review Chapter 4, 
“Designing Your Search Solution,” on page 41 before creating your first virtual search server. 


¢ If you have already created a Web Search solution, you might want to review Chapter 5, 
“Optimizing Search Results,” on page 45. 
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Designing Your Search Solution 


NetWare® Web Search Server is a search service solution designed for adding powerful search 
capabilities to individual Web sites. It is not intended to index the entire Internet. But because 
many Web sites are comprised of multiple Web and file servers located across an enterprise, Web 
Search is designed to be able to index hundreds, even thousands, of Web sites and file servers as 
part of a single search solution. 


This chapter includes the following topics: 
+ “Components of a Virtual Search Server” on page 41 
+ “Deciding If You Need More Than One Virtual Search Server” on page 42 
+ “Becoming a Search Service Host” on page 42 


+ “What's Next” on page 43 


Components of a Virtual Search Server 


A virtual search serveris a fully functioning, self-contained search service created for a particular 
audience, such as a department, organization, or a specific group of customers. 


A virtual search server typically contains its own indexes, log files, administration interface, 
search and print templates, scheduled events, virtual search server name, and an optional alias. 
When you create a new virtual search server, a new directory is created in the sys://NSearch/Sites 
sub-directory that contains supporting configuration files and sub-folders for storing indexes. 


Web Search 
root directory 


= |) Nsearch 
= (5) docs 
= (5) Nsearch 
E |) Sites 
= (5) default 
E (5) Marketing 
ri El (5) indexes 
El (5) The Whole Site 
E (5) vs digitalairlines. corn 
= (5) Templates 
= (E) WEB-INF 


Virtual search 
server's indexes 


Providing search services involves creating one or more virtual search servers. 


NOTE: Users cannot search more than one virtual search server at a time. However, a virtual search server 
can contain indexes created from content on multiple Web sites or file servers. 
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Taking the time to plan your search service strategy can save you time and money and improve the 
quality of your service. 


When you create a new virtual search server, you create an independent search service, meaning 
that it is self-contained and doesn’t depend on, or interact with, other virtual search servers. 


Each virtual search server that you create typically contains one or more of the following 
components: 


+ Indexes: Files that hold key words and associated URLs of Web sites or file server content that 
have been indexed, or crawled. 


¢ Scheduled Events: Index management, such as updating or regenerating, can be automated to 
occur at specific intervals using the Scheduling feature. 


+ Search and Print Results Templates: Templates that become populated with the results of a 
search and then are displayed to the user. Depending on which templates are used, the level 
of detail displayed in search and print results varies. 


+ Themes: A theme is a collection of templates that share a common look and feel and that work 
together to provide a rich end-user search experience. A theme includes your search page, 
search and print results pages, and response and error message pages. 


Deciding If You Need More Than One Virtual Search Server 


To determine if you need more than one virtual search server, answer the following questions: 
Q) Do you want to host search services for multiple, independent organizations? 
U Do you want to consolidate multiple NetWare 5.1 Web Search servers onto a single machine? 


A Do you need to prevent users from being able to search across multiple indexes at the same 
time? 


If you answered yes to any of these, you will likely need to create more than one virtual search 
server. Otherwise, a single virtual search server might suffice. For more information about virtual 
search servers, see Chapter 6, “Creating and Managing Virtual Search Servers,” on page 57. 
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Companies who want customers to find information about their products typically out source this 
function to search service companies. The following diagram shows how a search query on the 
Web site www.digitalairlines.com is sent to a Web Search server on the domain 
search.digitalairlines.com. 
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11) User enters 


search query on 
www.digitalairlines.com. 


Search is sent to 
search.digitalairlines.com 
which is hosted by 

Web Search Server. 


© Web Search Server 
sends search results list 
to user. 


(4) User clicks a search 
result to retrieve 
documents from 
www.digitalairlines.com. 


With NetWare Web Search Server, you can offer professional search services for other companies. 
Using a single installation of Web Search, you can host several virtual search servers 
simultaneously, which means that you could use the same NetWare server to host search services 
for several client or customer Web sites. 


What’s Next 


Once you have thought out your search service strategy, you can begin creating and defining your 
virtual search servers by referring to Chapter 6, “Creating and Managing Virtual Search Servers,” 
on page 57. 


To learn more about customizing your search service, start by reading Chapter 7, “Understanding 
Templates,” on page 81. If you are already familiar with Web Search and its search and print 
templates, you might want to skip to Chapter 8, “Working with Template Variables and Search 
Parameters,” on page 87. 
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Optimizing Search Results 


There are a number of ways you can optimize the performance of your virtual search servers. One 
of the most effective methods is through planning your search solution before building it. This 
includes optimizing the content to be searched before indexing it. (For more information, see 
Chapter 4, “Designing Your Search Solution,” on page 41.) 


This chapter discusses other things you can do after your search solution is already in place. It 
includes the following topics: 


+ “Improving Search Results through Intelligent Indexing” on page 46 

+ “Modifying Document Descriptions Returned in a Search Results List” on page 48 
+ “Improving Search Results” on page 48 

+ “Helping Users Avoid Failed Searches” on page 52 

+ “Weighted Queries” on page 53 

+ “Ensuring Optimal Search Speed” on page 53 

+ “Making Good Use of Document Fields” on page 54 

+ “Searching XML Documents” on page 54 

+ “Using the &filter Query Parameter” on page 55 


Reviewing Query Log Reports 


Before you begin changing various Web Search settings, set up and review query log files for clues 
about where your search service needs improvements. 


Query logging captures many details about user queries, including total number of searches 
performed (for the current logging period), top 100 search terms, load statistics, and the number 
of print jobs performed. It also provides information about queries that resulted in a "not found". 
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Improving Search Results through Intelligent Indexing 


You can improve the accuracy of your search results by following these indexing guidelines: 


0 When defining and creating your indexes, start with the highest-level Web Site URLs and File 


System Paths possible. 


A If content is showing up in your search results that you don’t want included, try removing 
some paths or URLs from your defined indexes. Also, try excluding specific subdirectories 


that you know or suspect might contain content that you don’t want searched. 


A Ifyou've indexed too many file types and cluttered your search results, try removing file types 
that you don’t want indexed by using the Extensions to Exclude option on the Define Index 


page. 
Q Use the Robots META tag in your Web site’s content. 


QO) Exclude documents or specific sections of documents, including headers, footers, and 
navigation bars. 


Excluding Documents from Being Indexed 


One way to improve search results is to guard what content is actually indexed, thus clearing a path 


for relevant information. 
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Using the Extensions to Exclude Option 


You can use the Extensions to Exclude option to direct Web Search to ignore specific file types. 
For example, if you don’t want Word or PowerPoint* documents to be included in search results, 
you would enter DOC and PPT in the Extensions to Exclude field. When these document types are 
encountered during and indexing job, Web Search skips over them. 


Using the Extensions to Include Option 


As mentioned above, you can use the Extensions to Exclude option to direct Web Search to ignore 
specific file types. However, if you can't specify all of the extensions to exclude, use the 
Extensions to Include option and specify all acceptable file extensions. A typical list would specify 
HTM, HTML, PDF, TXT, and DOC. 


TIP: When entering extensions in the Extensions to Exclude box, separate each extension by a space or a 
hard return. Avoid using commas. For example: 


htm html pdf txt doc 


Using the Robots META Tag 


Another effective way of controlling what Web Search indexes is using the Robots META tag. 
This tag is inserted into header section of a document and contains instructions about what should 
(or should not) be indexed. 


When a Web-based search engine encounters a document containing the Robots META tag, the 
search engine will do as the META tag instructs. 


There are several values you can specify in the Robots META tag: 
+ NOINDEX: Indicates that the document is not to be indexed. 
+ NOFOLLOW: Indicates that hypertext links in the document are not to be crawled. 
+ FOLLOWINDEX: Indicates that hypertext links in the document should be crawled. 
+ ALL: Indicates that the document can be indexed and all links can be crawled. 


+ NONE: Indicates that the document is not to be indexed and that hypertext links are not to be 
crawled. 


To include the Robots META tag, use this syntax: 


<META name="Robots" content="value, optional_value"> 


Using the Robots Comment Tag 


You can also use the Robots Comment tag to exclude specific sections of HTML documents from 
your search results. For example, you might not want such sections as repetitive headers, footers, 
navigation bars, and server-side includes to be indexed. 


TIP: You can also place these tags at the top and bottom of all include files so these sections never get 
indexed when part of a larger document. 


To direct Web Search where to begin skipping content while indexing: 


1 At the point in your HTML document where you want Web Search to begin skipping content 
while indexing, enter the following tag: 


<!—--*Robots Nolndex--> 
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2 


3 


Just after the content you want skipped, enter the following tag: 


<!--*Robots Index--> 


Save your changes and index (or reindex) the content. 


Modifying Document Descriptions Returned in a Search Results 


List 


Web Search returns descriptions of each hit that is listed on the search results page. By default, the 
following information is returned for each result: 


+ 


+ 


+ 


+ 


Description field 

Summary field 

Abstract field 

The first 255 characters of the document (beginning with first heading and skipping links) 


The first three fields are taken from the content of META tags in HTML documents or from 
document summary fields in other document types such as Word or PDF files. If these tags or fields 
are not defined, Web Search will try to find the first heading and begin selecting words. If it can’t 
find a heading, then it begins at the top of the document and selects the first 255 relevant display 
bytes as the description. 


Improving Search Results 


There are many things you can do to improve the speed, accuracy, and relevance of search results 
for end users. 


Improving the Relevance of Search Results 


Web Search utilizes a sophisticated relevance-ranking algorithm. During a search, Web Search 
considers 


+ 


+ 


The number of times words appear in a document 


The proximity of words in a multiple word search (the closer the words appear, the more 
relevant the document will be) 


The order of words in a multiple word search (the exact order of words is more relevant) 


The location of words in a document (specifically words that appear in a META tag, title, 
body, header, footer, etc.) 


The formatting of words in a document (such as bold, font type and size, etc.) 
Query weighting in a multiple query scenario 


The number of times words occur within an entire index (for example, the word the has low 
relevance) 


To illustrate how these criteria work, consider the following examples: 


+ 


+ 


Words in bold face are more relevant than regular words. 


Words contained in the <Title> tag are more relevant than words contained within the <body> 
tag. 
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+ Words contained in the Keywords and Description META tags are more relevant than content 
words. 


+ Words contained within the <A HREF= tag used for creating links are less relevant than 
words outside of this tag. 


+ A document containing a specified search term multiple times is more relevant than a 
document that contains the search term only once. 


+ A word within a 36-point body text is more relevant than within 4-point footer text. 


+ Documents returned from a query that is weighted at 100% is more relevant than a 50% 
weighted query. This is normally used in multi-query searches where each query has a 
specified weight. For example: 


query0=netwareéweight 0=100&queryl=groupwise&weight1=100 


In addition to Web Search’s inherent capabilities, you can further enhance the speed and accuracy 
of search results by enabling and configuring additional search features. 


Using Stop Words Processing to Improve Search Speed 


Sometimes users include irrelevant words in their search strings, such as the conjunctions to and 
of. These are referred to as stop words. When enabled, the Stop Words feature of Web Search 
removes all occurrences of stop words from the search string before performing a search. 


A set of common stop words are included in Web Search, but you can easily add your own, or even 
remove the one or more of the ones we have included. 


Before a virtual search server can use stop words processing, it must first be enabled on the Web 
Search server under Global Settings. 
To enable Stop Words processing on a Web Search server: 
1 From the Global Settings page of Web Search Manager, click General under Default Settings. 
2 Under Query Settings, click Yes next to Enable Stop-Words Processing. 
3 (Optional) Click Edit List to modify the default list of stop-words. 
4 Click Apply Settings. 


To enable stop words processing on a virtual search server: 


41 From the Web Search Manager Global Settings page, click Edit in the row of the virtual search 
server that you would like to enable stop words processing on. 


2 Under Settings, click General. 

3 Click Yes next to Enable Stop Words Processing. 

4 (Optional) Click Edit List to modify the default list of stop words. 
5 Click Apply Settings. 


Using Best Bets to Help Users Find the Right Information 


Best bets is a secondary results list that appears at the top of the search results page and is generated 
from a special-purpose index, or an index created for the express purpose of generating a best bets 
results list. 
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A best bets list can help users find what they are looking for more quickly by bringing the most 
popular or most important things to the top of the results page. 


A special-purpose index typically contains information about the most popular, most recent, or 
most important documents. 
To enable best bets on a Web Search server: 

1 From Global Settings, click Search under Default Settings. 

2 Click Yes next to Enable Best Bets Search Results. 


3 (Optional) If you want the Best Bets results to show automatically on the search results page, 
click No next to Show Best Bets Searches By Default. 


4 (Optional) In the Maximum Number of Best Bets Results Per Page field, type the maximum 
number of Best Bets results to be returned on each search results page. 


5 Click Apply Settings. 


To enable Best Bets on a virtual search server: 


1 From Global Settings, click Manage in the row of the virtual search server that you want to 
modify. 


2 Under Settings, click Search. 
3 Click Yes next to Enable Best Bets Search Results. 


4 Click Edit next to the Default Best Bets Indexes To Search field and select the indexes for use 
with Best Bets. 


5 If you want the Best Bets results to show automatically on the search results page, click Yes 
next to Show Best Bets Searches By Default. 


6 In the Maximum Number of Best Bets Results Per Page field, type the maximum number of 
Best Bets results to be returned on each search results page. 


7 Click Apply Settings. 


Using Synonyms to Broaden Search Results 
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When enabled, a synonym enhanced search returns documents in the search results that contain 
synonyms of the user”s original search terms. Search results might be less relevant when this 
feature is enabled, but it can lead users to documents they might not otherwise find because they 
don't know the exact terminology. 


While common synonyms are included in Web Search’s Synonym List, you can add new ones and 
delete existing ones. 


When enabling synonym enhanced searches, keep the following things in mind: 
+ A synonym-derived search result is slightly less relevant than the original term. 


+ A documents containing both the original search term and one of its synonyms is more 
relevant than a document with only the original term. 


+ Administrators control the Synonym list. 
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To enable synonym enhanced searches on a Web Search server: 
1 From the Global Settings page of Web Search Manager, click General under Default Settings. 
2 Click Yes next to Enable Synonym-enhanced Search Results. 
3 Click Apply Settings. 


To enable synonym enhanced searches on a virtual search server: 


1 From the Global Settings page of Web Search Manager, click select a virtual search server 
from the Virtual Search Server List and click Manage. 


2 Click General under Settings. 
3 Click Yes next to Enable Synonym-enhanced Search Results. 
4 Click Apply Settings. 


To Edit the Synonyms List 


The Synonym List contains a list of default synonyms included with Web Search. The synonyms 
are grouped by sets. A set is one row of synonyms in the list and contains words that are common 
synonyms of each other word in the same set. 


Each word in a set is preceded by a pair of brackets containing a combination of two plus (+) or 
minus (-) signs, which identifies how the word they precede is to be interpreted. 


The first + (or -) before a word specifies whether the other words in the set can use this word as a 
synonym. For example, if the word adjust was preceded by a +, any other word in the same set 
could use adjust as a synonym. 


The second + (or -) before a word specifies whether that word can use other words in the set as its 
synonym. For example, if the word adjust was preceded by a -, then adjust could use any other 
word in the same set as its synonym. 


When you have finished making changes by adding or deleting words and assigning the proper + 
or - symbols, click Apply. 


Redirecting Searches 


The redirection feature lets you specify key words that redirect the user’s Web browser to a specific 
URL. For example, searching for one net on www.novell.com redirects your browser to a special 
page designed to emphasize Novell’s One Net strategy, rather than returning the search results 


page. 
To enable search term redirection on a Web Search server: 

1 From Global Settings, click Search under Default Settings. 

2 Under Query Settings, click Yes next to Enable Search Term Redirection. 


3 (Optional) Click Edit List to create (or modify) the list of redirection terms and their 
associated URLs. 


For more information, see “Editing the Redirection URLs List” on page 52. 


4 Click Apply Settings. 
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Editing the Redirection URLs List 


To create or modify the redirection list: 
1 From Global Settings, click Search under Default Settings. 
2 Click Edit List to create (or modify) the list of redirection terms and their associated URLs. 
3 In the When Searching For Term field, type a search term. 
4 In the Go to URL field, type the associated URL. 


5 (Optional) Check the Only If Search Fails check box if you want the search query to be 
redirected if a search fails to return any results. 


6 (Optional) If you want additional control over when a search term is redirected to an alternate 
URL, check the Don’t Direct If check box and specify one or more of the following 
conditions: 


+ Select Body if you want redirection disabled when a specific word or phrase is found in 
the body of a document returned during a search. From the Conditions drop-down list, 
select a condition (equals, begins with, contains, or ends with) and enter a word or phrase 
in the text field at the right. 


+ Select the Response Code radio button if you want redirection disabled when a specific 
response code is returned. For example, if a user enters a search term that you have 
identified for redirection and a 404 Not Found error is returned for any reason, Web 
search won’t redirect the request to the alternate URL. Enter the response code to be used 
in the text field to the right of the Conditions drop-down list. 


+ Select Header if you want redirection disabled when a specific word or phrase is found 
in the header section of a document returned during a search. From the Conditions drop- 
down list, select a condition (equals, begins with, contains, or ends with) and enter a word 
or phrase in the text field at the right. 


7 Click Apply Settings. 


Helping Users Avoid Failed Searches 
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If Web Search cannot locate any documents matching a user’s search query, a Not Found message 
is returned. This is sometimes called a failed search. When you enable the search expansion 
feature, Web Search directs failed searches to additional indexes that you create for use with 
expanded searches. 


The best way to implement expanded searches is to create special indexes that are targeted to very 
specific purposes. For example, you might create an index dedicated to sales reports information, 
which could help users who are trying to pinpoint sales reports for specific fiscal quarters. (For 
more information about how to create and manage indexes, see “Creating Indexes” on page 69.) 
To enable search expansion on a virtual search server: 


41 From the Web Search home page (Global Settings), select the virtual search server you want 
to configure. 


2 Under Settings, click Search. 
3 Under Query Settings, click Yes next to Enable Search Expansion. 


4 Click Edit next to the Default Search Expansion Indexes and select the indexes to be used. 
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5 Click Apply. 
6 Click Apply Settings. 


Weighted Queries 


A weighted query is used anytime you want to modify the order or relevance of certain hits in a 
user’s normal search results list or when you want to add additional search results users might not 
have identified in their queries. 


Web Search allows users to submit more than one query item as part of a single search request. 


The following query parameters are combined to identify a single search query item: 
&filter#= 

&filteroperator#= 

S&operator#= 

&query#= 

&weight#= 

One use of this feature could be to provide profile-enhanced search requests. For example, the 


following query returns French product downloads higher up in the search results list but does not 
eliminate results of any other language downloads: 


&équery0=product+downloadsé&weight 0=100&query1=/language=frenchéweight1=90 


This example directs Web Search to perform two completely separate searches. The search results 
from the two queries are then merged based on the relevance of the individual search results and 
the weighting of the respective query that produced them. 


Another example might be to give the search results from one index more or less relevance than 
the search results of another index when performing a multiple-index search. For example, the 
search results from Novell might be more relevant than the search results from Novonyx. 


To send multiple query items, these parameters must be grouped using a number (#) at the end of 
the parameter name so they will be interpreted properly. The numbering should begin at 0 or 1 and 
increment sequentially for each additional query item. 


Ensuring Optimal Search Speed 


Once a virtual search server has been accessed, all of its configuration files are read into memory. 
For speed reasons, the virtual search server remains cached in memory until a period of inactivity 
has elapsed. The virtual search server is then dynamically removed from memory until its next use. 
Because of this, the first time a virtual search server is accessed is usually the slowest. 


However, there are other factors that can affect the performance of your Web Search services. As 
with any software, the amount of system resources (CPU, RAM, and hard drive) available affects 
Web Search Server performance. Web Search speed depends on the following factors: 


+ System processor speed 

+ Number of processors 

+ Amount of system memory (RAM) 

+ Number of hosted virtual search servers 


+ Number of indexes within each virtual search server 
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+ Number of files included within each index 

+ Number of indexes included within each query 
+ Number of queries performed at one time 

+ Complexity of users’ queries 


+ Number of search results returned with each results page 


+ Number of concurrent active indexing jobs 


+ Other functions being performed by your server 


Adjusting any of these values can have a significant impact on the performance of your search 
services. 


As a general guideline, use the fastest CPU possible and include as much RAM as possible. 
Although the duration of each user query is very short, while it is active it consumes an average of 
500 KB of memory. Memory consumption varies widely while the indexer is calculating the final 
search results list, depending on the number of possible search results. 


Also, try to schedule the regeneration of your indexes during off-peak hours. That way, they won't 
interfere with normal user searches. (See “Automating Index and Server Maintenance” on 
page 78.) 


Making Good Use of Document Fields 


A document field is any META tag or document summary field that helps to identify the 
document’s contents. A document summary field might be a title, heading, or paragraph contained 
in a TITLE or META tag within an HTML document. 


Web Search is designed to take advantage of document fields in order to improve the accuracy, 
relevance, display information, and speed of search results. 


By design, Web Search always indexes all document fields in many document types, including 
HTML, PDF, Word, WordPerfect, XML, etc. Users can then constrain searches to the contents of 
any document field. 


As a Web Search administrator, you can also use document fields to further restrict search results 
to certain products, categories, authors, titles, keywords, or any other content belonging to a 
document field. 

To perform a field-restricted search, use the /fieldname=search_criteria search operator. 


TIP: You might consider sending this information as hidden data using the &filter= query parameter. For 
example: 


£filter=/product=netware 


Searching XML Documents 
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XML documents provide a tremendous advantage to narrowing search results because of their 
hierarchical structure and use of multiple document summary fields. 


Web Search provides complete hierarchical searching using the fieldname=search_criteria 
operator. For example, you can find information anywhere in the XML document, within any of 
the title tags, or limit it to within the title tag that is part of the <DOCUMENT><SUMMARY> 
hierarchy. 
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The following table shows example uses of the fieldname=search_criteria operator when 
performing a search in XML documents. 


Example Values 


search_criteria 


Result 


Finds search_criteria anywhere in the document. 


/<Document*=search_criteria 


Finds search_criteria anywhere within any tag that is part of the DOCUMENT 
hierarchy. 


/<Document<Summary*=search_ criteria 


Finds search_criteria within any tag that is part of the <DOCUMENT> or 
<SUMMARY> hierarchy. 


/<Document<Summary<Title=search_ criteria 


Finds search_criteria only within the <DOCUMENT><SUMMARY><TITLE> 
hierarchy. 


/<Document*<Title=search_criteria 


Finds search_criteria within any TITLE tag, located at any level within the 
DOCUMENT hierarchy. 


/<*<Title=search_criteria 


Finds the search_criteria within any TITLE tag in the document. 


Using the &filter Query Parameter 


The &filter query parameter allows Web Search administrators to enhance searches by adding 
hidden, additional query details when users submit a search query. This is an enhancement over 
previous versions of Web Search, which required that you use Java Script to add additional details 
to search queries. 


The &filter query parameter works just like the & query= parameter and can be used together using 
the optional number (#) value. For example, if the query parameter was £query0=search_criteria, 
the matching filter parameter would be &filterO=additional_hidden_search_criteria. This allows 
the multiple weighted queries feature to work as designed while allowing administrators to add 
additional query details to each query. 


Unlike the &query parameter, the &filter parameter can be sent multiple times. For example, if 
users search for software patches, you could include the various products to be searched, which 
could then improve search time and accuracy: 


query=software patchesfilter=/Products=Product257filter=/ 
Products=Product16filter=/Products=Product 302 


The resultant URL might appear as follows, but with the HTTP and domain name prefix: 


&équery=softwaretpatcheséfilter=s2FProducts%3DProduct257&filter=%2FProducts%3DProduct16é&filter 
=$2FProducts%3DProduct 302 


NOTE: All &filter operators are combined using default the 8operator=value, AND. Also, the default Boolean 
conjunction joining the various filter operators is an OR search. You can change the default Boolean 
conjunction by using the &filteroperator=# query parameter. The pound sign (#) here acts just like the one used 
in the #operator=# query parameter. 
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Creating and Managing Virtual Search Servers 


This chapter provides detailed information about how to create and manage virtual search servers 
and their associated indexes using NetWare® Web Search Manager. It contains the following 
sections: 


+ “About Virtual Search Servers” on page 57 

+ “Creating a Virtual Search Server” on page 58 

+ “Enabling, Disabling, or Deleting a Virtual Search Server” on page 59 
+ “Configuring a Virtual Search Server” on page 60 

+ “Creating Indexes” on page 69 

+ “Managing Existing Index Files” on page 76 

+ “About Indexing Dynamic Web Content” on page 77 

+ “Access Control to Search Results” on page 77 

+ “Automating Index and Server Maintenance” on page 78 


+ “Backing Up Your Virtual Search Server Files” on page 79 


About Virtual Search Servers 


By definition, a virtual search server is a collection of one or more indexes and their related 
configuration files. Indexes and templates are at the heart of a virtual search server. An index is an 
optimized binary file that contains keywords found in documents hosted on a Web or file server. 
Indexes are used by Web Search to return search results to users” Web browsers. Templates are 
HTML documents that contain dynamic content. The dynamic content is generated by the use of 
search parameters and variables inserted in various places in the templates. Templates are 
customizable and are used for several things, including displaying search and print results to users. 


For more information about templates, see Chapter 7, “Understanding Templates,” on page 81. 


Before creating virtual search servers, particularly large or mission-critical ones, you should 
carefully plan how to best set up Web Search to meet requirements of your search services. A 
search service used by a small to medium department in a company requires different planning 
than a search service intended to serve thousands of customers on an enterprise wide intranet Web 
site. 


For information about how to plan an effective search service, see Chapter 4, “Designing Your 
Search Solution,” on page 41. 
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Creating a Virtual Search Server 


Once you have carefully planned your search service, you can start creating and configuring virtual 
search servers and begin adding indexes to them. 


1 From the Web Search Manager Global Settings page, click Add New Virtual Search Server. 


2 Inthe Name field, enter a new virtual search server name, which is typically the DNS or 
domain name of your server. 


For more information about virtual search server names, see “Naming a Virtual Search 
Server” on page 58. 


3 Inthe Alias field, enter a virtual search server alias, which is typically the IP address of your 
server. 


See “Using the Virtual Search Server Alias” on page 59 for more information about aliases. 


4 Inthe Location field, enter the path to where you want the index and configuration files to be 
stored. 


TIP: If this field is left blank, Web Search will store the virtual search server files in the /searchroot/sites/ 
sitename directory. Also, you can store the files on any volume on the server where Web Search is 
installed, but not on other servers. 


5 Click Create. 


Naming a Virtual Search Server 


When a user sends a search query to the Web Search Server, Web Search must determine which of 
all of your virtual search servers it should use to handle the incoming search request. 


Web Search uses two methods for determining this: 


1. Matching the domain name of the search query with the virtual search server names available 
in Web Search 


2. Using the server=searchsitename query parameter to find matching virtual search server 
names 


For example, in the following search request, Web Search uses the domain name 
search.domainnamel.com as the name of the virtual search server: 


http://search.domainnamel .com/NSearch/SearchServlet ?query=find+something 


This approach requires that your server be set up to recognize the domain name 
search.domainnamel.com. Most servers can be set up to recognize and service multiple domain 
names in both software and hardware virtual server configurations (see “Setting Up Multiple Web 
Servers” on page 62). 


You could also use an IP address to designate the virtual search server. For multiple virtual search 
servers, this approach would work only in a hardware virtual server configuration where each 
virtual search server has its own unique IP address. 
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If you are hosting a search service for two or more customers, you can name each virtual search 
server according to the organization or company name of each customer and then use the server 
query parameter when handling search queries. One of the advantages of using the &server query 
parameter is that it allows you to use a single DNS name. 
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For example, suppose your server's URL was searchit.novell.com. If you were setting up search 

services for a company called Digital Airlines and another company called DemoCity, you could 
host both services on your single server and then simply include the &server=digitalairlines and 
&server=democity query parameters within the search forms found on www.digitalairlines.com 

and www.democity.com. 


Queries would be sent from the search forms on each Web site to the URLs corresponding to each 
virtual search server, as in the following: 


http://searchit.novell.com/NSearch/SearchServlet?server=digitalairlines 
and 


http://searchit.novell.com/NSearch/SearchServlet?server=democity 


Using the Virtual Search Server Alias 


When defining a virtual search server, you are required to give it a name. But Web Search 
administrators can also define an alias that can be used when identifying a specific virtual search 
server during a search request. 


An alias name typically follows one of two conventions: 


1. An IP address: This could be used either in the domain name portion of a URL or be included 
in a search query using the &server query parameter. Using an IP address in place of a domain 
name to select a virtual search server only works in a hardware virtual server configuration 
where each search server has its own unique IP address. 


2. Any other numeric or textual value that can be passed as the value of the &server query 
parameter. 


For most virtual search servers, the best choice for a search server name and alias is the Web 
server’s domain name and IP address.For more information about creating software and hardware 
virtual servers on the NetWare Enterprise Web Server, see “Setting Up Multiple Web Servers” on 
page 62. 


Storing Virtual Search Server Files 


Search server files include a set of index and configuration files for each virtual search server. 
When you create a new virtual search server, you can specify where you want virtual search server 
files to be stored, or you can accept the default path which is determined by where you installed 
the NetWare Web Search Server. 


Virtual search server files can be stored on any volume visible to the NetWare server that Web 
Search is installed on, regardless of which volume your Web Search Server is installed on. This 
includes SAN storage device volumes. 


Enabling, Disabling, or Deleting a Virtual Search Server 


You can disable a virtual search server or delete it from Web Search. When you disable a virtual 
search server, users will receive an Unavailable Service message and will not be able to perform 
any searches. When you delete a virtual search server, all of its indexes and all related files are 
permanently deleted from your server. 


Creating and Managing Virtual Search Servers 59 


To Enable or Disable a Virtual Search Server 


1 From the Global Settings page, click Manage in the row of the virtual search server that you 
want to disable. 


2 Under Settings, click On/Off. 
3 Click Turn ON or Turn Off to enable or disable the current virtual search server. 


When Web Search turns off the current virtual search server, the status above the Turn ON and 
Turn OFF buttons changes to OFF. 


To Delete a Virtual Search Server 


4 From the Global Settings page, click Delete in the in the row of the virtual search server that 
you want deleted. 


2 Click Delete Virtual Search Server to confirm the deletion. 
or 
Click Cancel Deletion to abort. 


WARNING: There is no way to restore a deleted virtual search server. Exercise caution before 
proceeding. 


Configuring a Virtual Search Server 


Once you have created a virtual search server, you can fine tune it by modifying many of its default 
settings. This section describes how to configure each virtual search server. 


TIP: When you create a new virtual search server, all of its default settings are inherited from the Global 
Settings pages of Web Search. If you are the global administrator, you can modify these settings so that when 
you create a new virtual search server, its default settings will reflect your preferences. (See “Configuring 
NetWare Web Search Server” on page 22.) 


Configuring General Settings 


The General Settings page lets you configure the way that the virtual search server handles 
requests from clients for search services. You can modify general search query, search response, 
error log, and e-mail settings, if the global administrator has enabled the e-mail feature. 


To modify general search query settings: 


1 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Click General under Settings. 


3 From the Default Query Encoding drop-down list, select an encoding that represents the 
character set encoding that the users of your search services are most likely to use. 


For more information about character sets, see Appendix B, “Combined Character Sets for 
Use with NetWare Web Search,” on page 127. 


4 In the Maximum Query Duration field, enter the maximum number of seconds before Web 
Search should end a query, regardless of whether a search has been completed. 


This option is one of several methods for letting you protect your server’s resources from 
processing potential rogue searches, which are sometimes intended to harm your service by 
consuming server resources. 
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5 (Optional) Click Yes next to Enable Stop-words Processing if you want Web Search to ignore 
insignificant words, such as adverbs, conjunctions, or prepositions, in a user’s search query. 


For information about how to modify the list of Stop-words used by Web Search, see “Editing 
the Stop-Words List” on page 62. 


6 (Optional) Click Yes next to Enable Synonym Enhanced Search Results if you want Web 
search to expand search queries by looking for synonyms of the original search terms. 


For more information about synonym enhanced searches, see “Using Synonyms to Broaden 
Search Results” on page 50. 


7 Click Apply Settings. 


To modify query logging settings: 


When query logging is enabled, it captures many details about user queries, including total number 
of searches performed (for the current logging period), top 100 search terms, load statistics, and 
the number of print jobs performed. It also provides information about queries that resulted in a 
"not found" error message. This information can be used to improve the performance of your 
search services, or to identify areas of your site that could be improved. 


Query logging is enabled by default. However, it is optional and can be turned off by selecting No 
next to Enable Query Logging. 


1 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Click General under Settings. 
3 Click Yes next to Enable Query Logging. 


4 In the Exclude these IP Addresses field, enter one or more IP addresses of the computers that 
you want excluded from the query log, separating each additional address by a space or hard 
return. 


This feature enables you to eliminate query logging for searches originating within your 
organization. Keeping query log information gathered from customer queries separate from 
log information related to employees of your own company can help you identify issues that 
directly affect your customers. 


5 From the Log Period drop-down list, select a log period of either Monthly or Weekly. 


Web Search records search requests in the current log file until the end of the specified period. 
When Web Search switches to a new log file, a report for the old log file is then automatically 
generated. 


6 In the E-mail Log Reports field, type one or more email addresses where you want copies of 
each new log report sent, separating each additional address by a space or hard return. 


NOTE: If this field does not appear, it is because you have disabled e-mail services on your NetWare 
Web Search Server. To re-enable e-mail services, go to the Web Search Global Settings page and click 
Services Settings > General > E-Mail Settings. 


7 To view an existing log report, select one from the Available Log Reports field and click View 
Report. 
NOTE: If there are no logs listed, you have not yet generated a log report. Click Generate Current to 
create a report of the current (not yet completed) log period. Depending on the amount of information in 


the logs, this process could take from a few seconds up to several hours to complete. After a new report 
is generated, it appears in this field. 
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8 (Optional) If you want to specify a different logging template, you can do so by entering the 


name of the template in the Template to Use When Generating Reports field. 


9 Click Apply Settings. 


To modify general response settings: 


1 Under Response Settings, select an output encoding from the Default Encoding for Response 


Pages drop-down list. 


This setting specifies the encoding Web Search should use when responding to user queries 
using the search and print results templates, and the error and response messages templates. 


2 Enter the maximum number of queries in the Refuse Queries if Potential Hits Exceed field to 


cancel the processing of search results that might take a long time to complete. 


3 Click Apply Settings. 


To modify error log settings: 


1 In the Maximum Log Size field, enter the maximum size (in bytes) that Web Search should 


allow the log file to grow to. 


Depending on the number of visitors that your virtual search server hosts, log files can become 
large. This setting protects your system’s hard drive resources. 
TIP: The number you specify here is divided evenly between two log files. For example, if you specify 


30000, each log file would allow up to 15000 bytes of logged data. This would ensure that you would 
always have at least 15000 bytes of logged synchronization data. 


2 Click Apply Settings. 


To modify e-mail settings: 


TIP: If this section of the General Settings page is not visible, it is because the global administrator has 
disabled it. If you are the global administrator, you can enable this feature from the Global Settings > Services 
Settings page. 


1 (Optional) Click Yes next to Enable E-mail Services if you want Web Search to generate an 


e-mail message when errors occur during the generation (or regeneration) of your virtual 
search server's indexes, or when your indexes are being synchronized with other Web Search 
servers. 


(Optional) If you enabled e-mail services, type one or more e-mail addresses to which error 
messages should be sent. 


If the global administrator has specified default e-mail recipients, they will appear here. You 
can remove them, or simply add additional addresses. Separate addresses using a space, 
comma, semi-colon, or carriage return. 


3 Click Apply Settings. 
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You can add or remove words from the Stop-words list. Web Search uses this list to determine 
which words it will ignore in a user’s search string. Web Search includes a pre-defined list of stop- 
words, but you can edit or change these at any time. 


To edit the Stop-words list: 
1 From the Web Search Manager home page (Global Settings), select the virtual search server 


you want to manage from the Virtual Search Server List by clicking Manage. 
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2 
3 
4 


5 
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Click General under Settings. 
Under Query Settings, click Edit List next to Enable Stop-Words Processing. 
(Optional) To add a new word to the Stop-words list, type a new word directly into the list. 


Separate each new word with a space or a carriage return. When you click Apply, the word is 
added to the list in alphabetical order, regardless of where you entered it in the list. 


(Optional) To remove an existing stop word from the Stop-words List, select it and press the 
Delete key. 


Click Apply. 


For information about enabling and editing the synonym enhanced search settings, see “Using 
Synonyms to Broaden Search Results” on page 50. 


Configuring Search Settings 


The Search Settings page lets you configure the way that the virtual search server handles end 
user’s search queries. You can modify search query, search response, and template settings. 


To modify search query settings: 


1 


2 
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From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


Under Settings, click Search. 
Under Query Settings, click Edit next to Default Indexes To Search. 


Select the indexes to be searched by default when a user does not select any indexes on the 
search form when performing a search. 


(Optional) Click Yes next to Enable Search Expansion if you want Web Search to 
automatically perform a second search using additional indexes when a first search query fails 
to find results. 


For more information, see “Helping Users Avoid Failed Searches” on page 52. 


(Optional) If you enabled Search Expansion, click Edit next to the Default Search Expansion 
Indexes field to select the indexes to be used during an expanded search. 


(Optional) Click Yes next to Enable Search Term Redirection if you want Web Search to 
redirect common search terms to a specific URL. 


For more information, see “Redirecting Searches” on page 51. 


(Optional) If you enabled Search Term Redirection, click Edit List to add common terms and 
their associated URLs. 


For more information, see “Editing the Redirection URLs List” on page 52. 


(Optional) Click Yes next to Enable Best Bets Search Results if you want Web Search to 
insert a secondary results list at the top of the search results page. 


For more information, see “Using Best Bets to Help Users Find the Right Information” on 
page 49. 


(Optional) Click Edit next to the Default Best Bets Indexes To Search field and select the 
indexes for use with Best Bets. 


(Optional) If you want the Best Bets results to show automatically on the search results page, 
click No next to Show Best Bets Searches By Default. 
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12 (Optional) In the Maximum Number of Best Bets Results Per Page field, type the maximum 
number of Best Bets results to be returned on each search results page. 


13 Click Apply Settings. 


To modify search response settings: 


41 Under Response Settings, enter the number of search results in the Default Number of Results 
to Display field that you want displayed on each search results page. 


For example, if you set this to 25 (which is the default setting) and the number of hits in a 
return was 200, Web Search would only return 25 hits per search results page at a time. 


2 Set a limit on the number of results allowed at one time on the results page by entering a 
number in the Maximum Number of Results to Display field. 


3 Enter the highest number of search results that can be returned to a user query in the Highest 
Allowed Result Number field. 


4 Click Yes next to Enable Search Terms Highlighter if you want users! search terms to be 
highlighted in the documents returned in a search. 


5 Click Edit Colors to modify the colors used by the Highlighter. 
For information, see Selecting Highlighter Colors below. 


6 Click Apply Settings. 


To modify template settings: 


1 Under Template Settings, enter a path to where your Web Search templates are stored in the 
Templates Directory field. 


TIP: The default path is volume:\searchroot\Templates, but if you have created custom templates or for 
some reason want to keep your templates elsewhere, specify the path here so that Web Search knows 
where the templates are. 


2 From the Default Encoding for Templates drop-down list, select the character set that your 
templates are written in. 


This value will be used even with templates that do not specify an encoding. Encodings found 
in templates that do not match the encoding you specify here will override this encoding. 


3 Inthe Default Search Page Template field, enter the filename of the search page template you 
want to use. 


If you have created a custom template and want Web Search to use it as your search page, enter 
its name in this field. 


4 In the Default Search Results Template field, enter the filename of the search results template 
you want to use. 


If you have created a custom search results template and want Web Search to use it as your 
default search results page, enter its name in this field. 


5 In the Template to Use If No Results Returned field, enter the filename of the template that 
Web Search should return if no results are found. 


6 In the Template to Use If Error Occurs field, enter the filename of the template that Web 
Search should return if there are errors while processing a user’s query. 


7 Click Apply Settings. 
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Selecting Highlighter Colors 


Because a user can search for more than one search term at a time, you can define multiple colors 
so that each search term appears in a different color. For example, if a user searched for "HTTP 
AND Apache", the terms appear highlighted in the documents where they originated. 


The colors are used in the order in which they are defined. If only two highlight colors are defined 
but a user searches for three search terms, the first color is repeated. 


1 
2 


4 
5 


From the Search Settings page, click Edit Colors under Response Settings. 


To define a new highlight color, click the Color button in the Foreground and Background 
columns to select a color. 


You can also enter the color value (such as #RRGGBB) or color names. 
To define additional color sets, click Add More Colors. 
To remove a defined color set, click Delete in the row of the color set you want removed. 


Click Apply. 


Configuring Print Settings 


The Print Settings page lets you configure the way that the current virtual search server handles 
end user’s print queries. You can modify print result and template settings. 


To modify default print settings: 


1 
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From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


Click Print under Settings. 


Under Print Results Settings, enter the number of print results in the Default Number of 
Results to Print field that you want displayed on each print results page. 


For example, if you set this to 25 (which is the default setting) and the number of hits in a 
return was 200, Web Search would only return 25 hits per print results page at a time. 


Set a limit on the number of results allowed at one time on the results page by entering a 
number in the Maximum Number of Results to Print field. 


Enter the highest number of search results that can be returned to a user query in the Highest 
Allowed Result Number field. 


To limit the size of a print job, specify the largest print job size that Web Search will allow in 
the Maximum Print Job Size field. 


Any users requesting a print job larger than this value will receive a message informing them 
that their request was too large. 


TIP: This is a useful feature to administrators who want to keep down the size of print jobs in their own 
companies, departments, or organizations. 


To be notified when a print job exceeds a certain size, enter the print job size in the Print Job 
Size Warning field. 


By default, this message is sent using the ResponseMessageTemplate.html file and is intended 
as a warning to users that they are exceeding the allowed print job size. It then prompts the 
user to confirm the print job before continuing. 


Click Apply Settings. 
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To modify default template settings: 


1 Under Template Settings, enter a path in the Templates Directory field to where your Web 
Search templates are stored. 


TIP: The default path is volume:\searchroot\Templates, but if you have created custom templates or for 
some reason want to keep your templates elsewhere, specify the path here so that Web Search knows 
where the templates are. 


2 From the Default Encoding for Templates drop-down list, select the character set that your 
templates are written in. 


This value will be used even with templates that do not specify an encoding. Encodings found 
in templates that do not match the encoding you specify here will override this encoding. 


3 Inthe Default Print Results Template field, enter the filename of the print results template you 
want to use. 


If you have created a custom print results template and want Web Search to use it when 
returning print results, enter its name in this field. 


4 In the Template to Use If No Results Returned field, enter the filename of the template that 
Web Search should return if no print results match a user’s query. 


5 Inthe Template to Use If More Information Is Needed field, enter the filename of the template 
to be sent back to users whose print jobs exceed the size you specify in the Print Job Size field. 
(See Step 6.) 


6 In the Template to Use If Error Occurs field, enter the filename of the template that Web 
Search should return if there are errors while processing a user’s print query. 


7 Click Apply Settings. 


Configuring Index Settings 


These settings are intended to make the process of creating indexes even easier by letting you 
configure common settings as default settings. This saves you time by not making you make the 
same selections each time you create a new index. 


To modify default index settings: 


1 From Web Search Manager’s Global Settings page, select the virtual search server you want 
to manage from the Virtual Search Server List by clicking Manage. 


2 Click Index under Settings. 


3 Select the type of index that you want as the default index type on the Indexing Management 
page. 
Each time you create a new index, the index type you select here will be automatically 
selected. Of course, you can select either index type when you create an index. 


4 Click Yes next to Obey Robots.txt Exclusions When Crawling to instruct Web Search to obey 
the instructions in the Robot.txt file as it indexes Web sites. 


For more information about Robots.txt, see “Using the Robots META Tag” on page 47. 


5 Click Yes next to Crawl Dynamic URLs (URLs Containing '?') if you want Web Search to 
index dynamic content, in addition to static content. 


TIP: Some search engines do not crawl Web pages that are created dynamically, such as pages 
generated from forms submitted by a Web browser. The URLs of dynamic content typically contain a 
question mark (?) followed by additional parameters. (See “About Indexing Dynamic Web Content” on 
page 77.) 
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Because dynamic content can change at any time, you might want to schedule more frequent 
regeneration events for your indexes when enabling this feature. For information about scheduling 
automatic updates to your indexes, see “Automating Index and Server Maintenance” on page 78. 


Check the URLs Are Case Sensitive check box if you want Web Search to recognize URLs 
that are different only in character case, but are otherwise identical. For example, 
www.digitalairlines.com verses www.DigitalAirlines.com. 


IMPORTANT: Setting this option to No can help Web Search avoid indexing duplicate information, which 
can come from indexing URLs that are presented using different cases but actually point to the same 
information. However, if a Web server being indexed is configured to differentiate between cases, Web 
Search might leave out content that you want indexed. 


In the Maximum Index Depth field, type the maximum number of hypertext links from the 
starting URL that Web Search should follow before it stops indexing. 


Enter a number (in bytes) in the Maximum File Size to Index field to keep Web Search from 
indexing files larger than the number you specify. 


In the Maximum Time to Download a URL field, enter a number (in seconds) before Web 
Search automatically skips the indexing of the specified URL. 


Type a number (in milliseconds) in the Delay Between URL Requests field that Web Search 
should pause between requests for URLs that it is trying to index. 


From the Encoding (If Not in META Tags) drop-down list, select the encoding to be used 
when indexing files that do not contain an encoding specification. 


For example, HTML files can specify their encoding with a Content-Type META tag. 
Click Apply Settings. 


To allow indexes to be used with Web Search Synchronization: 


1 
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Under Synchronization Settings, click Yes next to Index May Be Copied To Other Clustered 
Servers. 


For more information about Web Search Synchronization, see “Synchronizing Data Across 
Multiple Web Search Servers” on page 35. 


Click Apply Settings. 


To enable or disable user authentication when accessing indexes: 


1 


(Optional) Under Rights-Based Search Results, click Off to allow access to the indexes to 
anyone. 


No user authentication is required to search the indexes of the current virtual search server. 


(Optional) Under Rights-Based Search Results, click By Index to restrict access to the 
indexes only to those who have access rights to the filename you specify in the By Index text 
box. 


In the By Index text box, type the full path to a file on your server that already has rights 
protection assigned to it. 


For example, on a NetWare 6.5 server where Apache is your Web server, you might type 
sys:\\Apache2\htdocs\index.html. 


Select either Search Engine or Templates from the Unauthorized Hits Filtered By drop-down 
list to specify how Web Search should handle attempts to access indexes without 
authorization. 
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Select Engine if you don’t want any search results displayed when users attempt to search the 
index without first logging in. A No Results Found message is returned instead. 


Select Template to have Web Search return search results to users who have not logged in. 
When they attempt to click a search result, they are then prompted for a username and 
password. 


TIP: You can use the $$BeginUnAuthorized and $$EndUnAuthorized template variables to control how 
the template should display unauthorized hits. For more information about template variables, see 
Chapter 8, “Working with Template Variables and Search Parameters,” on page 87. 


5 Click Apply Settings. 
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Security settings let you manage access to indexed content by requiring users to authenticate to a 
server before seeing rights-protected search results. The Security Settings page lets you configure 
rights-based search results and specify secure connection settings, including enabling the HTTPS 
protocol for securing usernames and passwords as they are sent over the network. 


To modify default rights-based search results: 


1 From Web Search Manager’s Global Settings page, select the virtual search server you want 
to manage from the Virtual Search Server List by clicking Manage. 


2 Under Settings, click Security. 


3 In the Default Search Contexts text box, type the Novell® eDirectory™ context where user 
objects are stored. 


By entering a context here, users won't have to supply their fully-qualified user IDs when 
logging in to Web Search. For example, if your user objects are all kept in a container named 
employees, type employees.marketing.digitalairlines in the Default Search Contexts box so 
that Web Search knows where to look when a user attempts to log in. A user whose fully 
qualified name is sjones.employees.marketing.digitalairlines would only have to enter sjones. 


4 Click Yes next to Check Authorization By Directory if you want Web Search to validate user 
rights to files in a directory (search results) based on whether or not they have rights to any 
one file in the same directory. 


If a larger number of results are from the same directory, this can help to speed up the search. 


5 (Optional) If you are using basic authentication (as apposed to using form-based 
authentication), then in the Authentication Realm String field, type the correct authentication 
realm string, which is typically shown in your Web browser's login dialog box. 


TIP: Specifying the Apache Web server's authentication realm string in this field makes it so that once 
users authenticate to it, they won't have to authenticate again when using Web Search to search and 
access protected information. 


TIP: If Apache is your Web server, refer to http://httpd.apache.org/docs-2.0/howto/auth.html (http:// 
httpd.apache.org/docs-2.0/howto/auth.html) for more information about authentication. 


6 Click Apply Settings. 


To modify default connection settings: 


1 Under Connection Settings, click Yes next to Require HTTPS if you want to protect 
usernames and passwords as they are sent across the network or Internet. 
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2 Enter a number (in minutes) in the Auto-logout Time field to direct Web Search to log users 
out who have been idle for the specified period of time. 


3 Click Apply Settings. 


Configuring Synchronization Settings 


Web Search Synchronization lets you designate one Web Search server as the search master from 
which updated indexes, templates, and configuration settings are systematically sent out to all 
other Web Search servers defined as part of a Web Search Synchronization cluster. 


For more information about setting up and configuring Web Search Synchronization, see 
“Synchronizing Data Across Multiple Web Search Servers” on page 35. 


Creating Indexes 


Web Search creates two types of indexes: 


+ Crawled: Created as Web Search follows (or crawls) hypertext links until it reaches a dead 
end. Web Search can crawl one or more Web sites, specific areas of a Web site, or specific 
URLs, even down to a specific filename. 


+ File System: Created as Web Search indexes content on a file server. Web Search can index 
one or more paths on multiple volumes, including Storage Area Network (SAN) storage 
devices. 


There are two forms you can use to create each type of index: the standard form and the advanced 
form. 


For example, the Define Crawled Index is the standard form for creating a crawled index. But the 
Define Crawled Index (Advanced) form offers more options than the standard form, including 
options that override default virtual search server settings. Both methods are described in the 
following sections. 


Searching across Multiple Indexes 


Web Search can search across multiple indexes within a single virtual search server. However, 
searching a single index is generally faster than searching across multiple indexes. 


Restricting Search Results to Specific Areas 


You can restrict search results to specific areas of your file or Web server in the following ways: 
+ Using multiple indexes and using the &index=index_name query parameter. 


+ Using a single index, restrict results to certain URL paths using the &filefilter=path query 
parameter. 


+ Using a single index, restrict results to certain values in document fields by including / 
fieldname=value with either the query=value or filter=value search parameters. 


TIP: Using the last option requires that indexed documents contain summary fields such as META tags. This 
option works for almost any file format that contains document summary fields, including HTML, XML, PDF, 
Word*, and WordPerfect*. 


For information about preventing Web Search from indexing specific content, see “Excluding 
Documents from Being Indexed” on page 46. 
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About Indexing Content on a Password Protected Web Site 


If the Web servers you want to index require authentication, there are two methods for providing 
the correct user credentials: basic authentication and form-based authentication. Which one you 

choose depends on how authentication is implemented on the Web sites you will be indexing. For 
example, if you are indexing www.company1.com and it uses basic authentication, then enter the 
username (user ID) and password in the Basic Authentication fields. In this case, the credentials 

are sent using an HTTP authorization header with every request made to the server of the URL you 
have specified. 


However, if www.company1l.com uses a form-based authentication method, leave the Basic 
Authentication fields blank and type the correct user credentials in the Form-based Authentication 
text box, placing each new entry on its own line. For example: 


userid: admin 
password: novell 
context :novell 


tree:marketingtree 


In Form-based authentication, the first time the Web site is indexed, the credentials are sent and a 
session cookie is returned. Thereafter, Web Search uses the session ID in the cookie for 
authentication and the credentials are no longer sent to the Web site. 


TIP: If you are indexing more than one URL and each one requires a different set of credentials, we 
recommend that you create a separate index for each URL. 


Defining a New Crawled Index 
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1 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Under Define a New Index, click New Crawled Index, and Define Index. 
3 In the Index Name field, enter a name for your index. 


TIP: A name can be a word, phrase, or a numeric value. If the virtual search server you are working on 
contains, or will contain, a large number of indexes, you might want to utilize a numbering scheme to help 
you manage multiple indexes more effectively. But keep in mind that the name you enter here appears 
on the default search page. So you might want to choose a name that can be understood by users of your 
search services. 


4 Under Web Sites to Crawl, type the URL of the Web site that you want indexed. 


You can enter just the URL, such as www.mycompany.com, or you can also append a 
complete path, down to the file level, such as www.mycompany.com/path/index.html. 


5 If desired, add another URL. 
6 To add additional URLs, click Add More URLs. 
7 Click Apply Settings. 


Using the Define Crawled Index (Advanced) Page 


The Define Crawled Index (Advanced) page offers some additional options beyond those available 
in the standard Define Crawled Index page. Changes made using this page will override default 
virtual search server settings. 


41 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Under Define a New Index, click New Crawled Index > Define Index. 
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On the Define Crawled Index page, click Advanced Index Definition. 


In the Index Name field, enter a name for your new index. 


TIP: A name can be a word, phrase, or a numeric value. If the virtual search server you are working on 
contains, or will contain, a large number of indexes, you might want to utilize a numbering scheme to help 
you manage multiple indexes more effectively. But keep in mind that the name you enter here appears 
on the default search page. So you might want to choose a name that can be understood by users of your 
search services. 


In the Index Description field, enter an optional description of the index to be created. 
Under Web Sites to Crawl, enter the URL of the Web site to be indexed. 
TIP: If you enter a filename at the end of the URL, then just that file will be indexed. 


(Optional) Select the Use Only As a Crawl Filter if you don’t want Web Search to use the 
URL you specified in the URL of Web Site field to begin indexing. 


NOTE: Any subsequent links found that contain a URL matching the one you specified in the URL of Web 
Site field are followed and subequently indexed. 


(Optional) If you want to mask the actual URL displayed in the search results template, enter 
an alternate URL in the Show URL In Search Results As field. 


For example, if you want to index a Web server that is used inside of your company but allow 
your customers access to some of the data, you could hide the actual internal URL with the 
URL of your public Web site. 


In the Subdirectories to Exclude text box, type the directories that you want Web Search not 
to index. 


For example, /marketing or /sales/doc. 


To direct Web Search to include or exclude specific file types, click Extensions to Include or 
Extensions to Exclude and then enter the extensions, separating each one with a single space, 
such as HTM PDF TXT. 


To add additional URLs, click Define More Web Sites. 

To delete a URL, click Remove Web Site. 

In the Additional URLs text box, enter any other URLs that you want indexed. 
For example, www.mycompany.com/marketing. 


This allows you to specify additional pockets of information found on other Web sites, but not 
include all of the content of those sites to your searches. 


TIP: When Web Search encounters links found in the pages of Additional URLs that point to pages 
specified in Web Sites to Crawl, Web Search follows those links. All other links that go outside of Web 
Sites to Crawl are not followed. 


Under Additional Settings, enter the absolute path to where you want the index files stored in 
the Location of Index Files field. 


For example, volume:\searchroot\sites\mysites. 
By default, index files are stored at volume:\searchroot\sites\default\indexes\. 
TIP: Changes made to Additional Settings override Default Settings. 


From the Encoding (If Not in META Tags) drop-down list, select the encoding to be used by 
files being indexed that do not contain an encoding specification. 


In the Maximum File Size to Index field, enter the maximum file size (in bytes) that Web 
Search should index. 
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Files exceeding this size will not be indexed and therefore, will not be included in search 
results. 


In the Maximum Time to Download a URL field, enter a number (in seconds) before Web 
Search automatically skips the indexing of the specified URL. 


To direct Web Search to pay attention to case of filenames and directory names, click Yes next 
to URLs Are Case Sensitive. 


To direct Web Search to crawl dynamic content (URLs containing the question mark [?]), 
click Yes next to Crawl Dynamic URLs. 


TIP: For more information about indexing dynamic content, see “About Indexing Dynamic Web Content” 
on page 77. 


Click Yes next to Obey Robots.txt Exclusions When Crawling if you want Web Search to 
following instructions found in any Robots META tags. 


For more information, see “Using the Robots META Tag” on page 47. 


Click Yes next to Index May Be Copied to Other Clustered Servers if you want to allow this 
index to be copied to other servers in a Web Search Synchronization cluster. 


For more information about Web Search Synchronization, see “Synchronizing Data Across 
Multiple Web Search Servers” on page 35. 


Under User Credentials, specify the method of authentication for the servers that will be 
indexed that required user authentication in order to access them. 


+ Basic Authentication: If you know that the server to be indexed requires basic 
authentication, specify the username and password in the fields provided. 


+  Form-Based Authentication: If the server to be indexed uses form-based authentication, 
leave the Basic Authentication fields blank and type the correct user credentials in the 
Form-based Authentication text box, placing each new entry on its own line. For 
example: 


userid:admin 
password: novell 
context : novell 
tree:marketingtree 


(Optional) If the Web sites you are indexing require users to log in at a specific URL (such 
as login.digitalairlines.com), specify the login URLs in the Alternate Login URLs text box. 


Once the session cookies are returned, Web Search sends the appropriate ones as needed to 
the Web sites being indexed. 


In the HTTP Headers text box, enter any additional headers and values you would like 
included with each HTTP request, placing each header on a separate line. 


Some Web sites require specific information in HTTP headers when attempts are made to 
access them. If your Web site uses form or cookie based authentication, you can specify such 
information here. 


Click Apply Settings. 


To configure rights-based search results: 


1 


From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 
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Under Define a New Index, select New Crawled Index and click Define Index. 


On the Define Crawled Index page, click Advanced Index Definition. 


4 Under Rights-based Search Results, configure authorization checking by selecting from one 


5 


6 


of the following options: 


+ Use Default: Select this option if you want this index to use the default authorization 
checking setting specified on the Index Settings page of your virtual search server. 


+ Off: If you want all users to have access to this index, select this option. No authorization 
checking is done. 


+ By Index: To enable rights checking for this index, specify a file that exists on your server 
that can be used in verifying user access. By creating a file and setting access rights to it, 
Web Search can verify access to this index based on the rights to the file. Click Use 
Default Path if one was specified on the Index Settings page. 


From the Unauthorized Hits Filtered By drop-down list, select one of the following filters: 


+ Use Default: Select this option if you want the current index to use the default setting 
found on the Index Settings page. 


+ Search Engine: When you select this option, users attempting to search the index without 
first logging in will not see any of the unauthorized hits on the search results page. If the 
user doesn't have access to any search results, then the system returns a No Results Found 
message on the search results page. 


+ Templates: When you select this option, users attempting to search the index without first 
logging in to the system receive results, but they are then required to provide a username 
and password before being allowed to see the contents. 


Click Apply Settings. 


Once you define an index, you must generate it to make it searchable. See “Generating Indexes” 
on page 76. 


Defining a New File System Index 


1 


2 


From the Web Search Manager Global Settings page, click Manage in the row of the virtual 
search server that you want to work with. 


Under Define a New Index, click New File System Index > Define Index. 
In the Index Name field, enter a name for your index. 


TIP: A name can be a word, phrase, or a numeric value. If the virtual search server you are working on 
contains, or will contain, a large number of indexes, you might want to utilize a numbering scheme to help 
you manage multiple indexes more effectively. But keep in mind that the name you enter here appears 
on the default search page. So you might want to choose a name that can be understood by users of your 
search services. 


In the Server Path to be Indexed field, enter the absolute path to the folder containing the 
information that you want indexed. 


For example, SYS:\SALES\REPORTS. 


In the Corresponding URL Prefix field, enter the URL that should be used by the search 
results page to access the individual files. 


For example, /SALES. 
To add additional paths, click Add More Paths. 
Click Apply Settings. 
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Once you define an index, you must generate it to make it searchable. See “Generating Indexes” 
on page 76. 


Using the Define File System Index (Advanced) page: 
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From the Web Search Manager Global Settings page, click Manage in the row of the virtual 
search server that you want to work with. 


Under Define a New Index, click New Crawled Index > Define Index. 
On the Define File System Index page, click Advanced Index Definition. 
In the Index Name field, enter a name for your new index. 


TIP: A name can be a word, phrase, or a numeric value. If the virtual search server you are working on 
contains, or will contain, a large number of indexes, you might want to utilize a numbering scheme to help 
you manage multiple indexes more effectively. But keep in mind that the name you enter here appears 
on the default search page. So you might want to choose a name that can be understood by users of your 
search services. 


In the Index Description field, enter an optional description of the index to be created. 


Under Path Information, type the absolute path to the folder containing the information that 
you want indexed in the Server Path field. For example, SYS:\SALES\REPORTS. 


In the Corresponding URL Prefix field, enter the URL that should be used by the search 
results page to access the individual files. 


For example, /SALES. 


TIP: For information about defining a URL prefix in the NetWare Enterprise Web Server, see “Setting 
Additional Document Directories” on page 54. 


To exclude specific subdirectories from being indexed, enter their relative paths in the 
Subdirectories to Exclude field. 


To direct Web Search to include or exclude specific file types, click Extensions to Include or 
Extensions to Exclude and then type the extensions, separating each one with a single space, 
such as HTM PDF TXT. 


(Optional) To add additional paths, click Define More Paths. 
(Optional) To delete a path, click Remove Path. 


In the Location of Index Files field, enter the absolute path to where you want the index files 
stored. 


For example, SYS:\NSearch\sites\mysites. 
By default, index files are stored at volume:\searchroot\sites\site_name\ indexes\. 


From the Encoding (If Not in META Tags) drop-down list, select the encoding to be used 
when indexing files that do not contain an encoding specification. 


For example, HTML files can specify their encoding with a Content-Type META tag. 


In the Maximum Index Depth, specify the number of directories from the starting directory 
Web Search should crawl. 


This lets you limit how far (or deep) into a file server Web Search should crawl. 


In the Maximum File Size to Index field, enter the maximum file size (in bytes) that Web 
Search should index. 


Files exceeding this size will not be indexed and therefore, will not be included in search 
results. 
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16 (Optional) Click Yes next to Index May Be Copied To Other Clustered Servers if you want 
this index shared with other Web Search servers in a Web Search Syncronization cluster. 


For more information about Web Search Syncronization, see “Synchronizing Data Across 
Multiple Web Search Servers” on page 35. 


17 Click Apply Settings. 


To configure rights-based search results: 


1 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Under Define a New Index, select New File System Index and click Define Index. 
3 On the Define File System Index page, click Advanced Index Definition. 


4 Under Rights-based Search Results, configure authorization checking by selecting from one 
of the following options: 


+ Use Default: Select this option if you want this index to use the default authorization 
checking setting specified on the Index Settings page of your virtual search server. 


+ Off: Ifyou want all users to have access to this index, select this option. No authorization 
checking is done. 


+ By Index: To enable rights checking for this index, specify a file that exists on your server 
that can be used in verifying user access. By creating a file and setting access rights to it, 
Web Search can verify access to this index based on the rights to the file. Click Use 
Default Path if one was specified on the Index Settings page. 


+ By Result Item: If checked, Web Search verifies the user's access rights to each hit. This 
is not recommended for high traffic servers because checking every hit can slow down 
server performance. 


5 From the Unauthorized Hits Filtered By drop-down list, select one of the following filters: 


+ Use Default: Select this option if you want the current index to use the default setting 
found on the Index Settings page. 


+ Search Engine: When you select this option, users attempting to search the index without 
first logging in will not see any of the unauthorized hits on the search results page. If the 
user doesn't have access to any search results, then the system returns a No Results Found 
message on the search results page. 


+ Templates: When you select this option, users attempting to search the index without first 
logging in to the system receive results, but they are then required to provide a username 
and password before being allowed to see the contents. 


6 Click Apply Settings. 
Once you define an index, you must generate it to make it searchable. See “Generating Indexes” 
on page 76. 
About Indexing Volumes on Remote Servers 


You can index file content stored on remote volumes using the Novell NFS Gateway product, 
included with NetWare 6.5. 


To be able to index remote servers, first install and configure NFS Gateway. Then create a new file 
system index and specify the path to a volume on a remote server. Web Search does the rest. 
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For more information about installing and configuring NFS Gateway, see the NFS Gateway for 
NetWare (http://www.novell.com/documentation/beta/nfsgynw/index.html) documentation. 


Generating Indexes 


Once you define an index, you must generate it before it can be used for searching. Generating an 
index is the actual process where Web Search Server examines file server or Web server content, 
gathers keywords, titles, and descriptions and then includes them in the index. 


1 From the Web Search Manager Global Settings page, click Manage in the row of the virtual 
search server that you want to work with. 


2 Click Generate in the Action column of the index that you want to work with. 


The Active Jobs screen indicates the status of the current indexing jobs. When there is no 
current index job, the status page will read No indexing jobs are currently 
running or defined. 


3 To cancel the current indexing jobs, click Cancel in the Status column. 


You can direct Web Search to automatically update your indexes on specific dates and at specific 
times by scheduling events. For more information, see “Automating Index and Server 
Maintenance” on page 78. 


Managing Existing Index Files 


Once created, an index can then be edited or deleted. You can also view an index’s log file. (See 
“Working with the Log File” on page 76.) 


Editing an Index 


1 From the indexing Management page, click Edit in the Action column of the index you want 
to work with. 


2 Make any of the changes you need to and then click Apply Settings. 


TIP: If you used the Advanced page to create the index, it will appear automatically. However, you can 
also click Advanced Index Definition to make advanced changes to an index you created using the 
standard Index Definition page. 


3 Ifyou added new paths or URLs or modified any of the existing ones, you should regenerate 
the index to include the new content. 


Deleting an Index 


1 From the indexing Management page, click Delete in the Action column of the index you 
want to delete. 


2 In the Confirm Deletion of indexname page, click Delete Index to proceed, or click Cancel 
Deletion. 


WARNING: Once an index has been deleted, it cannot be restored. You must generate a new index. 


Working with the Log File 


The purpose of the log file is to help you identify any errors (and their possible causes) in 
performance during an indexing job. 
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In addition to reporting when the indexing job started and stopped, it also lists all files that were 
indexed, files that could not be found but were linked to, and even errors that might have occurred 
during the indexing process. 


To view an index’s log file, do the following: 


1 Click View Log in the Action column of the index that you want to work with. 


2 Review the contents of the log file and then either click your browser’s Back button to return 
to the indexing Management page, or click Management in the left frame of the Web Search 
Manager. 


About Indexing Dynamic Web Content 


Much of the content on the World Wide Web is static HTML, which means that after a static Web 
page is created, it remains the same until someone updates it. By contrast, many newer Web pages 
are created by Web applications, including servlets, Java Server Pages (JSP), Common Gateway 
Interfaces (CGI), and Pearl Scripts, and are usually created in response to user input. 


An example of dynamic Web content is an eCommerce Web page where items to be purchased are 
stored in a virtual shopping cart, the total cost is updated as users add or remove items from their 
shopping cart. 


Because the content changes regularly, many search engines don’t index dynamic content. 


NetWare Web Search includes the ability to index dynamic content. The URL of dynamic Web 
content typically includes a question mark (?). You can direct Web Search to index these URLs by 
setting the Crawl Dynamic URLs option to Yes. You could then create a scheduled event that 
regenerates the specified indexes every few minutes. 


Access Control to Search Results 


Security settings let you manage access to indexed content by requiring users to authenticate to a 
server before seeing search result content. 


In NetWare 6, Web Search depended on Enterprise Web Server NLM™ programs to authorize each 
search result for a particular user for those documents managed by eDirectory. Web Search Server 
now depends on Novell® eDirectory™. In addition to other enhancements, this allows user 
privileges to entire indexes rather than to each search result, which improves the over all speed at 
which search results requiring authentication are returned to the user. 

To configure rights-based search results: 


1 From the Web Search Manager home page (Global Settings), select the virtual search server 
you want to manage from the Virtual Search Server List by clicking Manage. 


2 Under Settings, click Security. 
3 Type the full context that your users share in the directory. 


Specifying the context here means that your users will not have to supply their fully-qualified 
user IDs when logging in to Web Search. 
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If User objects are stored in multiple containers, you can enter multiple contexts by separating 
them with carriage returns. For example: 

users .marketing.digitalairlines 

users.sales.digitalairlines 

users.support .digitalairlines 


4 Click Yes next to Check Authorization By Directory if you want Web Search to verify user 
rights to all files in a directory. 


Web Search allows access to all other files in any directory where the user has rights to at least 
one file. This method speeds up access rights checking because Web Search doesn't have to 
check rights for each file returned in a set of search results. 


5 In the Authentication Realm String text box, type the correct authentication realm string, 
which is typically shown in the Web browser's login dialog box. 


If Web Search’s realm string matches your Web server’s realm string, users only have to log 
in once. 


TIP: If Apache is your Web server, refer to the Authentication, Authorization and Access Control (http:// 
httpd.apache.org/docs-2.0/howto/auth.html) document on the Apache.org Web site for more information. 


6 Select Yes next to Require HTTPS if you want to enable HTTPS for user connections. 


IMPORTANT: We recommend that you enable HTTPS by selecting Yes, which will ensure that 
usernames and passwords are encrypted as they cross network wires. 


7 Inthe Auto-Logout Time field, type a number (in minutes) when Web Search should logout a 
user. 


This option is a security feature. Sometimes, users walk away from their computers. Other 
users could then have access to their search results. 


8 (Optional) Check Disable Auto-Logout if you don’t want it used during rights-protected 
searches. 


TIP: We recommend that you enable this feature as an added protection to secure content. 
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You can eliminate a lot of manual work in keeping indexes up to date by using Web Search’s index 
scheduling feature. Because the Web and file content you have indexed will eventually change, 
you can direct Web Search to update your indexes on specific dates and at specific times or 
intervals. 


Adding a Scheduled Event 


4 After selecting a search server from the Virtual Search Server List, click Scheduling in the left 
frame of Web Search Manager. 


2 Click Add Event. 


3 Specify the month, days, days of the week, or time (in hours and minutes) when you want Web 
Search to run the event. 


TIP: To select multiple dates and times, hold down the Ctrl key and click all of the items you want added. 
To select consecutive items, click the first item and then hold down the Shift key and click the last item. 


NetWare 6.5 Web Search Server Administration Guide 


4 Select the type of operation you want performed on your indexes. 
+ Update: Web Search identifies new content on Web or file servers and updates the index. 


+ Optimize: Web Search improves searching performance by removing unnecessary 
content and making the index file more compact. 


+ Regenerate: Web Search replaces the existing index with a newly generated one. 


5 In the Perform Operations On column, determine whether you want the chosen operation 
performed on all indexes or only on specified ones. 


TIP: If you have large indexes, you might consider creating multiple events that update your indexes at 
varied times. Doing so will minimize CPU utilization. By default, Web Search supports up to 5 
simultaneous indexing sessions. All other indexes will wait until a previous index job has completed. You 
can control the number of simultaneous indexing jobs from Services Settings. (See “Configuring Services 
Settings” on page 31.) 


6 Click Apply Settings. 


Editing or Deleting an Event 


1 After selecting a virtual search server from the Virtual Search Server List, click Scheduling in 
the left frame of Web Search Manager. 


TIP: If no events have been scheduled, refer to the procedure above for adding a scheduled event. 
To edit a scheduled event, click Edit in the row of the event you want to modify. 
Make the desired changes and click Apply Settings. 


To delete a scheduled event, click Delete in the row of the event you want to delete. 


a A ON 


Click Delete Event to confirm the deletion, or click Cancel Deletion. 


Backing Up Your Virtual Search Server Files 


As with any valuable data, you should make sure that your virtual search server files are backed 
up. At minimum, you should back up your index files, which by default are stored at 
volume:\NSearch\Sites\sitename\indexes. 


Ifyou have customized templates, you might also want to back them up. By default, they are stored 
at volume:\NSearch\Templates. 
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Understanding Templates 


NetWare® Web Search Server utilizes templates to generate search forms and search and print 
results as well as user feedback such as error or response messages. 


A template is an HTML document containing one or more Web Search Server variables. Template 
variables are used to produce dynamic results when a user performs a search on the virtual search 
server you have defined. 


Templates can be shared across virtual search servers or each virtual search server can point to its 
own set of templates. 


This chapter describes how templates work and discusses the default NetWare Web Search Server 
templates that are included. It includes the following topics: 


+ “How Templates Work” on page 81 

+ “Exploring the Default Search and Print Templates” on page 83 
+ “Error and Response Message Templates” on page 85 

+ “How Templates Use System Memory” on page 85 

+ “Working with Additional Languages” on page 85 

+ “What's Next” on page 85 


How Templates Work 


As defined above, a template is normally an HTML document containing one or more Web Search 
Server variables. When users search your virtual search server, they use a Web browser to access 
the search form template. See Figure 2, “The NetWare Web Search Form As It Appears in a Web 
Browser,” on page 82. 


The Search form template, Search Template.html, is stored (by default) in 
volume:\searchroot\templates. This path might be different if you chose to install Web Search in 
another directory. 
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Figure 2 The NetWare Web Search Form As It Appears in a Web Browser 
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The Web Search form is used to capture user input, select available indexes, and then return the 
results in either a search or print results template, which appears to the user in a dynamically 
updated HTML document. 


Search result templates display hits according to user selections on the search form. For more 
information about these search result templates, see Table 2 on page 84. 


There are also search and print templates for several different languages. For a discussion about 
creating templates for international languages, see Chapter 10, “Internationalizing Search 
Services,” on page 117. 


After a query is submitted and results are found, Web Search populates a results template with all 
relevant information for each search result. (See Figure 3 on page 83.) 
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Figure 3 A Search Results Page Produced by the Search Results Template, ResultListTemplate.html. 
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@ Internet 


You can also customize the search form to include additional parameters that allow you to offer 
more options to your users for more accurate searching. 


Exploring the Default Search and Print Templates 


NetWare Web Search Server includes several default templates used to create search forms and to 
format, display, and print search results for users. 


You can use the templates as they are or you can modify them to look and feel how you want them 
to. You can also create as many additional templates as you need or replace the default templates 
with your own templates. 


NetWare Web Search includes the five template categories: 


+ 


Search Page Templates 


¢ Search Result Templates 


+ 


Print Result Templates 
+ Error Message Template 


+ Response Message Template 


The templates are stored at volume:\searchroot\templates. 
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Search Page Templates 


NetWare Web Search includes two search page templates that are used to generate a search page, 
as described in the following table. 


Table 1 Default Search Page Templates 


Template Name Purpose 

SearchTemplate.html Lets users select a variety of options when performing searches 
and is the default search template used by NetWare Web Search 
Server. 

SearchTemplate.Simple Similar to SearchTemplate.html, except that this template 


contains no dynamic indexes. 


Search Result Templates 


NetWare Web Search includes several ready-made result templates, as described in the following 
table. 


Table 2 Default Search Result Templates 
Template Name Purpose 


ResultListTemplate.html Formats and organizes search results and offers additional 
sorting functions to the user. 


ResultListNoHits Template.html Indicates when no hits are found during a search and offers 
users a chance to refine their search. 


ResultListTerseTemplate.html Similar to ResultListTemplate but returns less information, 
such as dates and titles only. 


ResultListVerboseTemplate.html Similar to ResultListTemplate, but returns more information, 
such as file date, time, and language. Additional sort options 
are also provided. 


Print Result Templates 


From the search results page, users have the option of printing all files matching their search or 
only those files displayed on the current search results page. When one of these options is selected, 
the print result templates described in the following is displayed. 


Table 3 Default Print Result Templates 
Template Name Purpose 


PrintResultTemplate. html Combines the full contents of each of the files in the print 
request into a single document which is then displayed in 
the user's Web browser. A dynamic table of contents is also 
created. 


Once the entire content is downloaded to the browser, the 
browser's print dialog appears. 


PrintResultNoHitsTemplate.html Indicates when no documents are found during a print 
request. 
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Error and Response Message Templates 


In addition to the print, search, and search result templates, the error and response message 
templates are returned when an error occurs or when information is needed from the user. 


The default response message template is returned to convey a specific message to the user such 
as "Print job exceeds recommended size limits," typically returned when a user attempts to print 
more content than the Web administrator has allowed. 


The error and response message templates can be found at 
volume:\searchroot\TEMPLATES\ErrorMessageTemplate.html and 
ResponseMessageTemplate.html. 


How Templates Use System Memory 


Templates are cached in memory for quick rendering speed. Each template consumes 
approximately 10 KB. 


Similar to the virtual search server cache, templates remain cached in memory until a period of 
inactivity has elapsed. The template is then dynamically removed from memory until its next use. 
The first time a template is accessed, therefore, is normally the slowest. 


TIP: Too many templates in the template cache can consume a great deal of memory. Try to share templates 
across sites to minimize the impact on system memory resources. 


Working with Additional Languages 


NetWare Web Search includes each of the templates described above in each of several languages. 
Using standard encoding practices, you can internationalize your templates. 


Any changes made to the default templates should also be made to the language templates you will 
use. For a more complete discussion about creating a multilingual search solution, see Chapter 10, 
“Internationalizing Search Services,” on page 117. 


What’s Next 


To learn how to customize the default templates, see Chapter 9, “Customizing Your Search 
Solutions,” on page 113, and Chapter 8, “Working with Template Variables and Search 
Parameters,” on page 87. 
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Working with Template Variables and Search 


Parameters 


If you have a basic understanding of HTML, you can create an advanced search solution that your 
users can use to perform complex searches. 


Building an advanced search solution involves the use of Web Search template variables and 
search parameters to create or customize Web Search templates, and to create or customize one or 
more search forms. 


This chapter contains the following topics: 


+ 


+ 


+ 


“Guidelines for Using Variables” on page 87 
“Global Template Variables” on page 88 
“Search Page Variables” on page 95 

“Search Result Variables” on page 95 

“Print Result Variables” on page 99 
“Highlighter Variables” on page 100 

“Error Message Variables” on page 101 
“Response Message Variables” on page 101 


“Search Parameters” on page 102 


Guidelines for Using Variables 


Note the following guidelines when using variables to either customize the default templates or to 
create new templates from scratch: 


+ 


Case Sensitivity: All variables are case sensitive. Changing case in a variable will cause Web 
Search to ignore the variable. 


Variable Formatting: All variables must be used exactly as they appear in the tables in this 
chapter. Variables always begin with two dollar signs ($$) next to each other. 


Success of a Variable: The inclusion of a variable does not guarantee that information will be 
returned after a search is performed. For example, using the $$Author variable might not 
return the name of a document’s author if that information is not included in the META tag of 
the document. 


Internationalizing Templates: If you want to internationalize your templates, you must create 
a template for each language you want to support in your search solution. For more 
information about languages, see Chapter 10, “Internationalizing Search Services,” on 

page 117. 
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IMPORTANT: In prior versions of NetWare® Web Search Server, the term search site was defined as a 
collection of one or more indexes and related configuration files. To avoid confusion with the term Web site, 
the term was changed wherever it appeared in the documentation and in the variables and parameters. Search 
site is now referred to as virtual search server. 


New variables and parameters that parallel the term virtual search server have been added. Note that they 
function identically to the previous variables and parameters, and that the old variables and parameters can 
still be used. 


Similarly, the term collection has been changed to index. 
We recommend that you start using the newer variables and parameters so as to avoid confusion. 
For more information about how to implement variables in a search or print template, or how to 


implement search parameters in an HTML document to create a search form, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 


Adding a Search Box to Your Corporate Web Site 


To add a basic search box to a Web page on your Web site, add the following code at the location 
of the page where you want the search box to appear: 


<form name="SearchForm" method="get" action="/NSearch/SearchServlet"> 
<input type="text" name="query"> 
<input type="submit" value="Search"> 


</form> 


Global Template Variables 


Table 4 


Global template variables can be used in any of the Web Search templates. 


For more information about how to implement variables in a template, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 


Global Template Variables 
Name Description 


$$Authenticated Indicates whether or not the user is authenticated by returning 
either a 1 (True) or O (False). 


$$BeginAuthenticated Begins a section for a valid, logged-in user. If a user is 
authenticated, the text between the begin and end tags is 
processed and appears in the output. If a user is not authenticated, 
the text will be removed from the search results page. To control the 
appearance of unauthenticated search results, see 
“$$BeginUnAuthenticated” on page 90. 


See also “$$EndAuthenticated” on page 90. 


$$BeginBestBetIndexesLoop Begins a repeating section that lists best bet indexes used to 
produce the best bets search results list. This section is repeated for 
each best bet index. 


See also “$$EndBestBetIndexesLoop” on page 90. 
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Name Description 


$$BestBetIndex[number] Names of the best bets indexes the user specified in the search 
query. If the optional number is not provided, the current value of 
$$BestBetIndexesCurrent is used. 


See also “$$BeginBestBetIndexesLoop” on page 88. 


$$BestBetIndexesCount Number of best bets indexes associated with the user query. 


See also “$$BeginBestBetIndexesLoop” on page 88. 


$$BestBetIndexesCurrent Number of the current best bets index. 


See also “$$BeginBestBetIndexesLoop” on page 88. 


$$BestBetNum Total number of best bets results to display at a time. 


$$BestBetShow Returns True or False depending on Web Search Manager's 
Search Settings page. To override the default, use the &bbshow= 
true | false query parameter. 


$$BeginExpand|IndexesLoop Begins a repeating section that shows the search expansion 
indexes used if the primary indexes do not find any search results. 
This section is repeated for each search expansion index. 


$$BeginFiltersLoop Begins a repetitive section that is processed for each filter 
parameter associated with the current query item. Note that multiple 
query items can be sent as part of a single query. See also 
“$$EndFiltersLoop” on page 91. 


$$BeginIndexesLoop Begins a repetitive section that is processed for each index the user 
specified in the search query. 


See also “$$EndIndexesLoop” on page 91 and 
“$$Querylndex[number]’ on page 93. 


$$BeginLogin Begins a section of code used to define a login form that the user 
can use to login. 


This section is processed only if the &login=true query parameter is 
included with the Web Search request. 


$$BeginLoop End of the header section. Beginning of the repeating body section. 
This section is repeatedly parsed until there are no further result 
items to process. 


See also “$$EndLoop” on page 91. 


$$BeginNoLogin Informs users that the current search form does not require a login. 
Typically, this section is followed by a login button that users can 
click to receive a login form, which comes from the $$BeginLogin 
variable. 


If no login query parameter is passed to the server, then everything 
between this variable and $$EndNoLogin is returned to the user. 


See also “$$EndNoLogin” on page 91. 
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Name 


$$BeginQueryLoop 


Description 


Begins a repetitive section that is processed for each query item 
associated with the current search query. See “$$NumQueryltems” 
on page 92 for more information. 


See also “$$EndQueryLoop” on page 91. 


$$BeginReturnFieldsLoop 


The beginning of a repetitive section that is reprocessed for each 
return field the user specified in the search query. 


See also “S$QueryReturnField[number]” on page 93. 


$$BeginSortKeysLoop 


Begins a repetitive section that is processed for each sort key the 
user specified in the search query. 


See also “$$EndSortKeysLoop” on page 91 and 
“$$SortKeysCurrent” on page 94. 


$$BeginUnAuthenticated 


Begins a section for an unrecognized or logged-out user. Used in 
conjunction with $$EndUnAuthenticated. If a user is not recognized, 
the text between these two tags is processed and appears in the 
output. If the user is recognized as a valid, logged-in user, this text 
does not appear in the output. 


To control the appearance of authenticated search results, see 
“$$BeginAuthenticated” on page 88. 


$$Counter[variable_number, 
increment_number] 


Inserts the value of the specified variable_number counter into the 
search result page. All counters initialize to zero. The optional 
second parameter specifies the amount to increment or decrement 
the current value. A maximum of 10 counters is supported. 


For example: 
$$Counter[1] = insert value of counter #1 


$$Counter[1,1] = increment counter #1 by 1 and display the new 
value 


$$Counter[5,-3] = decrement counter #5 by 3 and display the new 
value 


$$DefaultQueryEncoding Default encoding of user query if not specified using the 
&encoding= query parameter. 
$$EndAuthenticated Ends a section for a valid, logged in user. 


See also “$$BeginAuthenticated” on page 88. 


$$EndBestBetIndexesLoop 


Closes the $$BeginBestBetIndexesLoop, which lists the best bets 
indexes used to produce the best bets results list. 


See also “$$BeginBestBetIndexesLoop” on page 88. 


$$EndExpandIndexesLoop 


Ends the $$BeginExpandedIndexesLoop section, which is used to 
get a list of search expansion indexes used by the current query. 


See also “$$BeginExpandIndexesLoop” on page 89. 
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Name 


$$EndFiltersLoop 


Description 


Ends a repetitive section that is processed for each filter parameter 
associated with the current query item. 


See also “$$BeginFiltersLoop” on page 89. 


$$EndIndexesLoop 


Ends a repetitive section that will be processed for each index the 
user specified in the search query. 


See also “$$BeginIndexesLoop” on page 89 and 
“$$Querylndex[number]’ on page 93. 


$$EndLogin Closes the $$BeginLogin section, which is used to produce a login 
form. 
See also “$$BeginLogin” on page 89. 
$$EndLoop End of the repeating body section. Beginning of the footer section. 
$$EndNoLogin Closes the $$BeginNoLogin section, which is used to specify that 
the user is not currently logged in. This section appears when no 
login parameter is passed to the server. 
See also “$$BeginNoLogin’” on page 89. 
$$EndQueryLoop Ends a repetitive section that is processed for each query item 
associated with the current search query. See “$$NumQueryltems” 
on page 92 for more information. 
See also “$$BeginQueryLoop” on page 90. 
$$EndReturnFieldsLoop End of a repetitive section that is reprocessed for each return field 
the user specified in the search query. 
See also “$$QueryReturnField[number]’ on page 93. 
$$EndSortKeysLoop Ends a repetitive section that is processed for each sort key the user 
specified in the search query. 
See also “$$BeginSortKeysLoop” on page 90 and 
“$$SortKeysCurrent” on page 94. 
$$EndUnAuthenticated Ends a section for an unrecognized or logged out user. For more 


information, see “$$BeginUnAuthenticated” on page 90. 


$$ExpandindexesCount 


Number of search expansion indexes associated with the user 
query. 


See also “$$BeginExpandIndexesLoop” on page 89. 


$$ExpandIndexesCurrent 


Number of the current search expansion index. 


See also “$$BeginExpandIndexesLoop” on page 89. 


$$FilterCount 


Number of filters associated with the current query item. Note that 
multiple query items can be associated with a single query. 


$$FilterCurrent 


Number of the current filter associated with the current query item. 


$$FilterOperator 


Boolean operator used to join the filters associated with the current 
query item. The full set of filters is always joined to the current query 
item using the Boolean AND. 
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Name 


$$FilterValue[number] 


Description 


Pulls the value of the specified filter associated with the current 
query item. If the optional # parameter is not provided, the current 
filter loop value ($$FilterCurrent) is used. 


$$HostURL 


Generates the current URL up to, and including, the optional port 
number. 


$$IncludeFile[template_name] 


Automatically pulls in the designated template at the location of this 
variable. The included template can contain other template 
variables, which is processed as though they were a part of the 
original template. The template name parameter can be either a full 
FILE:// URL based on the file system of the server or a relative path 
based on the location of the parent template. The template name 
parameter can be located within quotation marks. See the 
ResultListTemplate. html file for an example use of this variable. 


$$IndexesCount 


Number of indexes associated with the user query. 


See also “$$BeginIndexesLoop” on page 89. 


$$IndexesCurrent 


Number of the current index. 


See also “$$BeginIndexesLoop” on page 89. 


$$IsInvalidLogin[text] 


If a user's login is invalid, the text contained between the brackets 
is returned to the user. A typical message might be Invalid 
login. Please try again. 


$$NumQueryltems 


Number of query items contained within the current query. Although 
most queries use only one query item, it is possible to construct a 
query with multiple search criteria, each weighted with a value 
between 1 and 100. The resultant search contains hits from each of 
the queries, but the search results are organized with the most 
relevant hits first (from any of the individual queries). 


$$Query[number] 


Query specified by the client in the search field. The optional 
number identifies the corresponding query item. The value of 
$$QueryCurrent is used if the optional number is not provided. 


See also “$$NumQueryltems’” on page 92 for more information. 


$$QueryCount 


Number of query items associated with the search query. 


See also “$$NumQueryltems’” on page 92. 


$$QueryCountry 


The country requested by the client. Note that this must be an 
uppercase, two-character value as specified in ISO 3166-1. 


$$QueryCurrent 


Number of the current query item. See “$$NumQueryltems” on 
page 92 for more information. 


See also “$$BeginQueryLoop” on page 90. 


$$QueryDate 


Begin date requested by the client. Only those documents dated on 
or after the specified date are returned in the search results. See the 
query parameter “date” on page 104 for more information. 


$$QueryEncoding 


Actual encoding used to interpret the query. This can be the same 
as the $$DefaultQueryEncoding, the value of the &encoding= query 
parameter, or UTF8. 
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Name 


$$QueryExpandIndex[number| 


Description 


Names of the search expansion indexes the user specified in the 
search query. If the optional number is not provided, the current 
value of $$ExpandIndexesCurrent is used. 


See also “$$BeginExpandindexesLoop” on page 89. 


$$QueryFileFilter 


Returns the filename filter associated with the user query. 


$$QueryIndex[number] Names of the indexes the user specified in the search query. If the 
optional number is not provided, the current value of 
$$IndexesCurrent is used. 
See also “$$BeginIndexesLoop” on page 89. 
$$QueryLanguage Language requested by the client. Note that this must be a 
lowercase, two-character value as specified in ISO 639. 
$$QueryNumHits Number of search results requested by the client. 
$$QueryOperator The type of the current search: 


0 = Boolean AND search 
1 = Boolean OR search 
2 = phrase search 


$$QueryReturnField[number] 


Name of the return fields the user specified in the search query. If 
the optional number is not provided, the current value of 
$$ReturnFieldsCurrent is used. 


See also “$$BeginReturnFieldsLoop” on page 90 and 
“$$EndReturnFieldsLoop” on page 91. 


$$QueryServerNamef[text] 


Identifies the name of the Virtual Search Server provided with the 
&server= query parameter. The optional text parameter can be 
provided in the following formats: 


$$QueryServerName = NameOfServer 
$$QueryServerNameltexf] = text NameOfServer 
$$QueryServerName[“%text] = text URLEncodedNameOfServer 


$$QueryServerNameltext $$QueryServerName text] = 
text NameOfServer text 


$$QueryServerName[%text $$QueryServerName text] = 
text URLEncodedNameOfServer text 


See also “$$ServerName” on page 94. 


$$QuerySynonymFlag 


Set to either True or False based on the current setting under Web 
Search Manager's General Settings page. See “Using Synonyms to 
Broaden Search Results” on page 50 for information about enabling 
synonym-enhanced searching). 


$$QueryTemplate 


Template name requested by the client. 


See also “$$TemplateName’” on page 95. 
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Name 


$$QueryTemplateTheme 


Description 


Template theme requested by the client. This is not necessarily the 
theme of the search result because the specified theme might not 
exist. 


See also “$$TemplateTheme” on page 95. 


$$QueryVersion 


Version number of the current query format. 


$$QueryWeight[number] 


Weighting of the current query item 1 to 100. If number is not 
specified, the value of $$QueryCurrent is used. See 
“$$NumQueryltems” on page 92 for more information. 


$$ResultEncoding 


Encoding used to return the current search results page. This is 
either the value of the valid &retencoding= query parameter or the 
default specified by the search administrator in the NetWare Web 
Search Manager. 


$$ReturnField[number] 


Name of the return fields the user specified in the search query. If 
the optional number is not provided, the value of 
$$ReturnFieldsCurrent will be used. 


See also “$$BeginReturnFieldsLoop” on page 90 and 
“$$EndReturnFieldsLoop” on page 91. 


$$ReturnFieldsCount 


Number of return fields specified in the search query. 


See also “S$BeginReturnFieldsLoop” on page 90. 


$$ReturnFieldsCurrent 


Number of the current iteration of the $$BeginReturnFieldsLoop. 


$$SearchFor[number] 


Query entered by the client into the search field. If the optional 
number is not provided, the value of $$QueryCurrent is used. See 
“$$Query[number]” on page 92 for more information. 


$$ServerName 


Name of the virtual search server that produced the current output. 


See also “S$QueryServerNameltext]” on page 93. 


$$ServerLocation 


Path on the network server to the virtual search server configuration 
files and indexes. 


$$SortField[number] 


The name of the field to sort on. If the optional number is not 
provided, the value of $$SortKeysCurrent is used. See 
“$$SortByURL[sortfield.sortorder ...]” on page 98 and the query 
parameter “sortfieldquery_number” on page 109 for more 
information. 


$$SortKeysCount 


Number of sort keys associated with the current query. 


$$SortKeysCurrent 


Current sort keys number. See “$$BeginSortkeysLoop” on page 90 
for more information. 


$$SortOrder[number] 


Method of sorting the field (ascending, descending, and default). If 
the optional number is not provided, the value of 
$$SortKeysCurrent will be used. See “$$SortOrder[number]” on 
page 94 for more Information. 


NetWare 6.5 Web Search Server Administration Guide 


Name 


$$TemplateExt 


Description 


Filename extension of the template currently displayed in the 
browser. 


When an error occurs, Web Search automatically attempts to find 
an error message template that matches the filename extension of 
the requested search template. 


$$TemplateLocale 


Locale of the template, such as zh_TW. The locale information is 
taken from the template filename. 


$$TemplateName 


Filename of the template currently displayed in the browser. 


See also “$$QueryTemplate” on page 93. 


$$TemplateTheme 


Theme (or theme directory) that the current template belongs to. 


See also “$$QueryTemplateTheme” on page 94. 


$$UserlD 


Search Page Variables 


The User ID corresponding to the user who is currently logged in. 


The following table lists all available search page variables that can be used in addition to the 
global template variables to extend the functionality of the default search templates 
(SearchTemplate.html or SearchTemplate.Simple) or to create new templates from scratch. 


Table 5 Search Page Variables 
Name 


$$BeginServerlndexesLoop 


Description 


Begins a repeating section in the search template where information for 
each of the defined indexes is written. 


$$EndServerlndexesLoop 


Ends a repeating section in the search template where information for 
each of the defined indexes is written. 


$$ServerlndexDescription 


Description of the virtual search server defined in the Web Search 
Manager. 


$$ServerlndexName 


Search Result Variables 


Name of the virtual search server defined in the Web Search Manager. 


The following table lists all available search result variables that can be used in addition to the 
global template variables to extend the functionality of the default search result templates or to 
create new templates from scratch. 


For more information about how to customize templates, see Chapter 7, “Understanding 
Templates,” on page 81 and Chapter 9, “Customizing Your Search Solutions,” on page 113. 
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Table 6 


Search Result Variables 
Variable Name 


$$Author 


Description 


Name of the original author of a document returned in a hit. 


$$BeginAuthorized 


Begins a section for a search result that the user has rights to see. 
Used in conjunction with $$EndAuthorized. If a search result is 
authorized, this section of text and template variables is processed. 
If unauthorized, this section is removed from the output. 


See also “$$BeginUnAuthorized” on page 96. 


$$BeginBestBet 


Begins a repetitive section that is processed for each best bet 
search result item. 


Result detail variables, such as $$Title, $$Description, $$Index, and 
$$Relevance, can be used within this section. 


See also “$$EndBestBet’” on page 96. 


$$BeginUnAuthorized 


Begins a section for a search result that the user does not have 
rights to see. Used in conjunction with $$EndUnAuthorized. If a 
search result is not authorized, this section of text and template 
variables is processed. If the search result is authorized, this 
section is removed from the output. 


See also “$$BeginAuthorized” on page 96. 


$$DateTime[date_format] 


The date and time of a hit. This is automatically written in Java* 
medium format using the client’s locale (all calendars, translations, 
and date and time formats are observed). 


$$DateTime[ ] can use an optional date and time format provided 
within the brackets [ ]. The text should conform to the Java 
DateFormat syntax. 


$$Description Abstract, description, or first 255 display bytes of the result item. 
$$Encoding Character set encoding of the current search result item. 
$$EndAuthorized Ends a section for a search result that the user has rights to see. For 
more information, see “$$BeginAuthorized” on page 96. 
$$EndBestBet Ends the $$BeginBestBet section, which is used to display best 
bets results. See “S$BeginBestBet” on page 96. 
$$EndUnAuthorized Ends a section for a search result item that the user does not have 


rights to see. For more information, see “55BeginUnAuthorized” on 
page 96. 


$$FileFormat 


Indicates a specific document type. For example, HTML, Word 97, 
or PowerPoint. 


TIP: You can control the text output for each file format using the 
optional FileFormats. properties file. For more information, see Web 
Search product Web page (http:/Awww.novell.com/products/ 
websearch/fileformats.html). 


$$FirstHit 


Hit number of the first item in the current result page. Is displayed 
using the client’s locale. 
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Variable Name 


$$HighlightURL [text] 


Description 


If the source document of a search result is capable of being 
highlighted (HTML or text files), then the text contained within the 
brackets is displayed. This variable can be used as a marker to 
identify which of the search results can display highlighted search 
terms. Typically, $$HighlightURL is also included within the 
brackets and thereby outputs the URL to be used to highlight the 
current document. 


$$lndex 


Name of the index in which a particular search result item was 
found. 


$$lsExpandedSearch[tex¢] 


Displays a message indicating when a set of results was produced 
from expanded search indexes. The message is placed between 
the brackets [ ] and might read something like The query you 
were looking for was not found in the selected 
indexes. The displayed search results were produced 
from additional search indexes. 


$$Language Language of the result item. $$Language is displayed in the 
language of the client's locale. 
$$LastHit Hit number of the last item in the current result page. Is displayed 


using the client’s locale. 


$$MoreHits[page#, text] 


Conditional text section to be included only if there are additional 
hits in the search results that can be retrieved. 


If the first section of the conditional text contains a number followed 
by a comma (for example: $$MoreHits[3, text to be included]), then 
the server will first determine if the designated search results page 
exists. If page# is missing, 1 (the next page) is assumed. If the 
designated page is available, the remaining text after the comma 
and up to the closing bracket is written to the result page. 


Note that the initial number is relative to the current page. That is, -1 
references the page immediately before the current page and 1 
references the page immediately after. Zero (0) refers to either the 
previous page or the next page. 


$$MoreHitsURL[page_number] 


URL needed to display another page of search results. The optional 
parameter identifies the desired search result page number. If not 
provided, 1 is assumed. Note that the page number is relative to the 
current page. That is, -1 refers to the page immediately before the 
current page and 1 references the page immediately after. Zero (0) 
refers to the current page. 


The URL is inserted only if the designated page exists. 


$$Number 


Hit number of the current result item. Possible numbers begin with 
1 and end with $$TotalHits. Is displayed using the client’s locale. 
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Variable Name 


$$PageNum|[page#] 


Description 


Page number corresponding to the current search results page. 
This variable is used when more search results are available than 
can fit on one page (such as when $$TotalHits is greater than the 
number of hits specified per page in the &numhits=# query 
parameter). 


The optional page# identifies the relative page from the current 
result page. That is, -1 refers to the page immediately before the 
current page and 1 references the page immediately after. Zero (0) 
refers to the current page. 


The page number is inserted only if the designated page exists. 


$$PrintURL[first_hit_number, 
number_of_hits] 


URL used to print the hits listed on the current search result page. 


The optional parameters can be specified to define the beginning 
search result number and the number of search results to include in 
the print job. 


The number_of_hits parameter can use the $$TotalHits template 
variable. 


$$Relevance 


How closely the result matches the user’s query, indicated by 
percentages (1% to 100%). 


$$SearchFor[number] Query entered by the client into the search field. See 
“$$Query[number]” on page 92 for more information. 

$$SearchTime Amount of time used to process the current search request. 
$$SearchTime is displayed using the client’s locale. 

$$Size Size of the data pointed to by the result item’s URL. Is displayed 
using the client’s locale. 

$$SortByDate Returns True or False depending on the &sortbydate=true_false 


query parameter. 


$$SortByURL [sortfield. sortorder 
| 


The URL used to show the current result page sorted by one or 
more search result fields. 


Sort field names include title, author, changedate, filelength, 
language, summary, relevance, url, index, format, and 
document_number. 


Optional sort orders include ascending and descending. 
Sort field and sort order names are separated by a period. 


Multiple sort fields are separated by a space. 


$$Title If a title is not available in documents being searched, $$URL is 
used instead; if the URL is unavailable, < title unavailable > is used. 

$$TotalHits Total number of hits that match the search query. This is not the 
same as the number of hits displayed in any particular result page. 
Is displayed using the client’s locale. 

$$URL URL of the result item. 
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Print Result Variables 


Table 7 


The following table lists all available print result variables that can be used in addition to the global 
template variables to extend the functionality of the default print result templates or to create new 


templates from scratch. 


For more information about how to implement variables in a template (HTML) page, see Chapter 
9, “Customizing Your Search Solutions,” on page 113. 


Print Result Variables 
Name 


$$BeginAuthorized 


Description 


Begins a section for a print result that the user has rights to see. Used in 
conjunction with $$EndAuthorized. If a search result is authorized, this 
section of text and template variables is processed. If unauthorized, this 
section is removed from the output. 


See also “$$BeginUnAuthorized” on page 96. 


$$BeginMimeType[text/ 
plain] 


Identifies special formatting to apply to individual print result items based 
on their mime-type. For example, text formats should generally be output 
using HTML's <pre> tag, such as in the following: 


$$BeginMimeType [text/plain] 


<PRE> 


$$EndMimeType 


See also “$$EndMimeType’” on page 99. 


$$BeginTOCList[text] 


Beginning of the table of contents repeating section. This section is 
repeatedly parsed until there are no further TOC result items to process. 


This is a conditional text section. The items within the brackets ( [] ) are 
processed only if the current item represents a change in the depth of the 
hierarchy. If $$Product appears within the conditional text, it is replaced 
only if the current item also represents a new product. 


$$BeginUnAuthorized 


Begins a section for a print result that the user does not have rights to see. 
Used in conjunction with $$EndUnAuthorized. If a print result is not 
authorized, this section of text and template variables is processed. If the 
print result is authorized, this section is removed from the output. 


See also “$$BeginAuthorized” on page 96. 


$$Bookmark HTML anchor name of the current result item. This can be used to jump 
from a TOC entry to the corresponding section within the print job. All 
bookmark entries begin with “novell_print_toc_” and are followed by the 
number of the current result item, as in novell_print_toc_1. 

$$Description Abstract, description, or first 255 display bytes of the result item. 

$$EndAuthorized Ends a section for a print result that the user has rights to see. For more 
information, see “$$BeginAuthorized” on page 96. 

$$EndMimeType Ends a $$BeginMimeType section. For more information, see 


“S$BeginMimeTypeltext/plain]” on page 99. 
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Name Description 
$$EndTOCList[tex¢] End of the table of contents section. 


This is a conditional text section. The items within the brackets ( [] ) are 
written out each time a result item occurs that decreases the depth of the 
hierarchy. If the depth of the current item is several levels fewer than the 
previous item, the text within the conditional text block is written out that 
many times. 


$$EndUnAuthorized Ends a section for a print result item that the user does not have rights to 
see. For more information, see “$$BeginUnAuthorized” on page 96. 


$$Number Hit number of the current result item. Possible numbers begin with 1 and 
end with $$TotalHits. Is displayed using the client's locale. 


$$Numindents Number of indentations required for the current Table of Contents entry. 
$$Product Name of the product associated with the current item in the table of 
contents. 


This displays only if this is the first result item within that product. 


See also “$$BeginTOCList[text]” on page 99. 


$$Title Title of the result item. For empty titles, <title unavailable> is displayed. Is 
localized using the client’s locale. 


$$TotalHits Total number of hits that match the search query. This is not the same as 
the number of hits displayed in any particular result page. Is displayed 
using the client's locale. 


$$URL URL of the result item. 


$$URLContent Entire contents of the URL are placed into the template at this location. 
The URL contents are not parsed to validate their data type, formatting, 
or functionality. Only text/plain and text/html files are printed. All other files 
are inserted into the print job as an error message. 


Highlighter Variables 


The following table lists all available highlighter variables that can be used in addition to the global 
template variables to extend the functionality of the default highlighter template or to create a new 
template from scratch. 


For more information about how to implement variables in a template, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 
Table 8 Highlighter Variables 
Name Description 


$$BeginMetaDataLoop Begins a loop used for formatting the META tags associated with the 
currently highlighted file. For example, if three META tags were found, this 
loop could produce three rows in a table, placing the data from one META 
tag in each of the three rows. 


See also “$$MetaName’” on page 101 and “S$MetaValue” on page 101. 
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Name Description 


$$BeginWordsLoop Begins a loop that outputs the search terms used to find the current 
document. Each search term is produced using the colors specified in 
Web Search Manager. 


See also “$$Word” on page 101. 


$$EndMetaDataLoop Ends the $$BeginMetaDataLoop section. 

$$EndWordsLoop Ends the $$BeginWordsLoop section. 

$$MetaName Name of the META data tag, such as Title or Description. 

$$MetaValue Lists the values of each of the META data tags found in a file. 

$$Word Lists all of the words to be highlighted. The words are produced using the 


colors specified in Web Search Manager. 


See the HighlighterTemplate.html file for an example. 


Error Message Variables 


Table 9 


The following table lists all available error message variables that can be used in addition to the 
global template variables to enhance the organization of the default error message template, or to 
create new templates from scratch. 


For more information about how to implement variables in a template, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 


Error Message Variables 


Name Description 


$$ErrorDescription Longer version of the message. This might include additional error details 


or problem resolution information. 


$$ErrorMessage Text version of the error. Generally quite terse. 


$$ErrorNumber Numeric version of the error. 


Response Message Variables 


The following table lists all available response message variables that can be used in addition to 
the global template variables to enhance the organization of the default response message 
templates or to create new templates from scratch. 


For more information about how to implement variables in a template, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 


NOTE: The repeating variables $$BeginLoop and $$EndLoop should not be used in a response message and 
will be ignored if used. 
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Table 10 


Response Message Variables 


Name Description 

$$Cancel[text] If the Cancel button is specified by Server logic, this parses and inserts the 
conditional text into the response page. Currently used by PrintServlet 
when a print job exceeds the print job size warning limit. 

$$Continue[text] If the Continue button is specified by Server logic, this parses and inserts 
the conditional text into the response page. Currently used by PrintServlet 
when a print job exceeds the print job size warning limit. 

$$Help[tex¢] If the Next button is specified by Server logic, this parses and inserts the 


conditional text into the response page. 


$$lgnore[tex¢] 


If the Ignore button is specified by Server logic, this parses and inserts the 
conditional text into the response page. 


$$Next[texd] Compare to $$Prev. 

$$No[texí] If the No button is specified by Server logic, this parses and inserts the 
conditional text into the response page. 

$$0K[text] If the OK button is specified by Server logic, this parses and inserts the 
conditional text into the response page. Currently used by PrintServlet 
when a print job exceeds the maximum print job size. 

$$Prev[text] If the Previous button is specified by Server logic, this parses and inserts 
the conditional text into the response page. 

$$ResponseNumber Numeric version of the response required of the user. 

$$ResponseMessage Text version of the response required of the user. Generally quite terse. 
Can often be used as a title. 

$$ResponseDescription Longer version of the message. This might include additional details or 
see also type of information. 

$$Retry[texd] If the Retry button is specified by Server logic, this parses and inserts the 
conditional text into the response page. 

$$URL URL to use when the Parent button is clicked. This must appear within the 
brackets of a button’s conditional text section. The URL logic is generated 
by the server. 

$$Yes[texe] If the Yes button is specified by Server logic, this parses and inserts the 


Search Parameters 


conditional text into the response page. 


The following table lists and describes all available search parameters. Each of these parameters 
can be used to extend or enhance the functionality of the search page templates or to create new 
search page templates from scratch. 


For more information about how to implement parameters in an HTML document, see Chapter 9, 
“Customizing Your Search Solutions,” on page 113. 


NOTE: If you use a parameter but leave its value blank, the default value for that parameter will be used. 


102 NetWare 6.5 Web Search Server Administration Guide 


Table 11 


Search Parameters 


Name Value Description 
basiclogin Boolean Displays the browser’s basic authentication dialog box. 
Syntax: basiclogin=true|false 
Options: True, False 
Example: basiclogin=True 
bbindex String Specifies which best bets index to use. Can be used multiple times 
to specify additional indexes. Overrides the default setting. 
Syntax: bbindex=variable 
Alternate Syntax: bbindex=indexname;indexname 
Example: bbindex=myindex 
Default: None (specified using Web Search Manager) 
bbshow Boolean Specifies whether or not the best bets list should be shown on the 
search results page. Overrides the default setting. 
Syntax: bbshow=truelfalse 
Options: True, False 
Example: bbshow=true 
Default: True (specified using Web Search Manager) 
bbnum Integer Specifies the number of best bets to show on the results page. 
Overrides the default setting. 
Syntax: bbnum=variable 
Options: Any positive number less than or equal to the maximum 
number specified in Web Search Manager 
Example: bbonum=5 
Default: None (specified using Web Search Manager) 
buttonpressed String A button pressed by the user. If this value is part of the query, then 
a response message should not be sent to the client. 
Syntax: buttonpressed=button_name 
Options: Yes, No, OK, Cancel, Continue, Ignore, Retry, Prev, Next, 
Help 
Example: buttonpressed=Cancel 
context String Overrides the user’s default context for the current login. 


Syntax: context=variable 
Example: context=sales.novell 


Default: None (specified using Web Search Manager) 
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Name Value Description 


country String Specifies your country using the two-character, uppercase country 
value derived from 1503166. 


Syntax: country=country code 
Example: country=TW 


Default: As specified by Web browser language preferences 


date Integer Specifies a date range to be searched in milliseconds. If you pass 
a positive number such as 940457147873, then Web Search 
creates a date and time based on the number of milliseconds 
elapsed since January 1, 1970; 12:00 a.m. For example, the 
number 940457147873 produces the search start date of October 
20, 1999, at 4:05:47 p.m. 


The example shows the number of milliseconds spanning a three- 
month time frame. The minus sign (-) before the number indicates 
three months back in time. 


Syntax: date=number 


Example: date=-7905600000 


encoding String Specifies the character set encoding used to encode the search 
request itself. 


Syntax: encoding=value 
Example: encoding=Shift_JIS 
Default: UTF-8 (specified using Web Search Manager) 


expandindex String Specifies an expanded search index. You can specify more than 
one index at a time. Overrides the default setting. 


Syntax: expandindex=variable 


Alternate Syntax: expandindex=indexname1;indexname2; 
indexname3 


Example: expandindex=developerindex 


Default: None (specified using Web Search Manager) 


filefilter String Filters search results based on their path, domain, filename, or 
extension. Uses the same query syntax as the &query= parameter. 


NOTE: If a primary &query= parameter is not provided, then Web 
Search automatically performs a filename only search. 


Syntax: filefilter=search_criteria 
Example: filefilter=.exe 


Example: filefilter=.com 
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Name Value Description 
filterquery_number String The &filter#= query parameter is used to send additional query 
details not specified by the user to help limit the scope of a search. 
Normally, these would be included as hidden fields on an HTML 
form. 
This parameter supports all of the same features and functionality 
as the &query= parameter. However, unlike the &query= 
parameter, this parameter can be sent multiple times for a single 
query item. 
The individual filters associated with a single query item are joined 
using the value of the filteroperator parameter. The set of filters is 
logically joined with the rest of the query item using the Boolean 
AND operator. 
Syntax: filterquery_number=searchcriteria 
Example: filterO=/product=GroupWise 
See also “filteroperatorquery_ number” on page 105. 
filteroperatorquery_ Number Boolean conjunction to be used between multiple filters (several 
number filters can be associated with a single query item). The complete 
set of filters is always associated with the corresponding query item 
using the Boolean AND operator. 
Syntax: filteroperatorquery_number=number 
Options: 0 (AND), 1 (OR), 2 (PHRASE) 
Example: filteroperator0=1 
Default: 1 (OR) 
See also the query parameters “operatorquery_number” on 
page 107 and “filterquery_number” on page 105. 
gettotalhits Boolean Enables or disables the total number of hits calculation. For 
example, if you set the GETTOTALHITS parameter to False, the 
Total Number of Hits label on the results page displays O (zero). 
Setting this parameter to True shows the total number of hits found 
during the search. In some complex situations, this can save 
valuable processing time. 
Syntax: gettotalhits=7rue|False 
Options: True, False 
Example: gettotalhits=False 
Default: True 
idquery_number String Document ID that is used to narrow a search. You can specify more 


than one ID by using the same field name more than once. 
Syntax: idquery_number=documentID 
Example: &id0=z1.0010.&id0=z1.0020 


Default: None 
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Name 


index 


Value 


String 


Description 


Restricts a search to one or more specified indexes. The index 
name you specify using this parameter must exactly match the 
name of an index defined at the server. 


You can specify more than one index by either sending this 
parameter more than once or by separating the list of indexes with 
a semicolon (;). 


Syntax: index=index_name1[;index_name2] 
Example: index=GroupWise&index=NetWare 
Example: index=GroupWise;NetWare 


Default: All indexes or the list of default indexes specified in Web 
Search Manager. 


lang 


String 


Specifies a language using the two-character, lowercase language 
value derived from 1506391. 


Syntax: lang=/anguage_code 
Example: lang=ja 


Default: Browser language preference 


login 


Boolean 


When set to True, displays a form-based login rather than the 
standard browser-based login dialog box. 


Syntax: login=True|False 
Options: True, False 


Example: login=True 


logout 


Boolean 


When set to True, logs out the current user. 
Syntax: logout=True|False 
Options: True, False 


Example: logout=True 


noexpand 


Boolean 


When set to True, turns off search expansion. 
Syntax: noexpand=variable 
Options: True, False 


Example: noexpand=True 


noredirect 


Boolean 


When set to True, turns URL redirection off. 
Syntax: noredirect=True|False 
Options: True, False 


Example: noredirect=True 
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Name 


numhits 


Value 


Integer 


Description 


Number of hits you want returned at one time in the search results 
page. 


Syntax: numhits=number 
Example: numhits=25 


Default: 25 (specified using Web Search Manager) 


operatorquery_number 


Integer 


Which operator to use between two or more words in a search. 
Syntax: operatorquery_number=number 

Options: 0 (AND), 1 (OR), 2 (PHRASE) 

Example: operator0=1 


Default: 0 (specified using Web Search Manager) 


password 


String 


User’s password for form-based logins. 
Syntax: password=variable 


Example: password=novell 


queryquery_number 


String 


Actual search criteria that is passed to the Web Search Server. 


Because multiple queries can be defined in a single search 
request, the number variable lets you group various parameters 
together that apply to a specific query. Adding the same number to 
two or more parameters groups them together so they can be 
applied to the same query. For example, 
&query0=product+downloads&weight0O=100 groups the &weight 
query parameter together with &queryO. 


This parameter is used most often with operatornumber, 
filternumber, filteroperatornumber, idnumber, weightnumber, and 
typenumber. 


Syntax: queryquery_number=searchcriteria 
Example: query0=novell+AND+groupwise 


For more information, see “Weighted Queries” on page 53. 


relevance 


String 


Whether or not to sort the search results by relevance. Turning this 
feature off is a potential speed gain because the sort algorithm will 
then not run. 


Syntax: relevance=True|False 
Options: True, False 
Example: relevance=False 


Default: True 
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108 


Name 


retencoding 


Value 


String 


Description 


Specifies the character set encoding to be used by the next results 
page returned to the user. 


Syntax: retencoding=character_set_encoding 
Example: retencoding=iso-8859-1 


Default: UTF8 (specified using Web Search Manager) 


retfield 


String 


Level of detail given about each result item. The fewer the details, 
the faster a search is returned to a user. 


Field names include title, author, URL, changedate, language, 
summary, relevance, index, format, and filelength. 


IMPORTANT: Type these fields exactly as they appear above. 


To specify more than one field, separate them with an ampersand 
(&). 


Syntax: retfield=field_name 
Example: retfield=title 


Example: retfield=title&retfield=author 


server 


String 


Name of the virtual search server which is to receive this request. 
This query parameter is optional if the domain name of the request 
matches the name or alias of a registered virtual search server. 


Syntax: server=virtual_search_server_name 
Example: server=digitalairlines 


Default: Domain name portion of search request 


showfirsthit 


Boolean 


If set to True, rather than displaying the search results page, this 
parameter automatically goes to the URL of the first hit on the 
current page. 


Syntax: showfirsthit= True|False 
Options: True, False 
Example: showfirsthit=True 


Default: False 


sortbydate 


String 


Sorts the Total Search Results list by date, ignoring the normal 
relevance ordering. 


Syntax: sortbydate=True|False 
Options: True, False 
Example: sortbydate=true 


Default: False 
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Name 


sortfieldquery_number 


Value 


String 


Description 


Specifies the fields on which to sort the search results returned ina 
results page. Grouped together with the sortorder query parameter 
by adding a number to the end of the parameter name. 


Field names include title, author, URL, changedate, language, 
summary, relevance, index, format, and filelength. 


IMPORTANT: Type these fields exactly as they appear above. 
Syntax: sortfieldquery_number=field_name 


Example: sortfield1=title 


sortkeys 


Integer 


Specifies the number of sort fields that should be used to sort the 
search results. 


Syntax: sortkeys=number 


Example: sortkeys=1 


sortorderquery_ 
number 


Integer 


Specifies the alphanumeric ordering of search result items (hits). 
Grouped together with the sortfield query parameter by adding a 
number to the end of the parameter name. 


Syntax: sortorderquery_number=number 
Options: 0 (Ascending), 1 (Descending), 2 (Default for each field) 


Example: sortorder1=0 


starthit 


Integer 


Hit number you want Web Search to begin searching from. If you 
specify a value of 35, Web Search returns hits beginning with hit 
number 35. 


Syntax: starthit=number 
Example: starthit=35 
Default: 1 


synflag 


String 


When set to False, turns off synonym-enhanced searching. Also 
overrides the default specified in Web Search Manager. 


Syntax: synflag=True|False 
Options: True, False 
Example: synflag=False 


Default: True 
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Name Value Description 


template String Specifies the specific results template you want your search results 
returned in. The following list of templates are the default templates 
included with the Web Search Server. However, your Web Search 
Server administrator might have created custom templates using 
different names. Check with your administrator if the default 
templates do not work for you. You must type the names of these 
templates exactly as they appear in this list: 


+ ResultListTemplate.html 

+ ResultListTerseTemplate.html 
+ ResultListVerbose.html 

+ PrintResultTemplate.html 

+ SearchTemplate.html 


+ HighlighterTemplate.html 


Localized versions for multiple languages can also be used. See 
“Working with Multiple Languages” on page 117. 


TIP: A number of different file formats can be used as Web Search 
templates. For example, Web Search ships both HTML and XML 
templates. Web Search uses the current template filename 
extension to determine which template filename to use next. For 
example, if a user specifies the ResultListTerseTemplate.xml file for 
the current query, but the search produces a Not Found condition, 
Web Search automatically tries to find a template named 
ResultListNoHits Template.xml. 


Syntax: template=filename 
Example: template=ResultList.html 


Default: Search Page (SearchTemplate.html), Search Results 
(ResultListTemplate.html), and Print (PrintResultTemplate.html) 


Default templates are specified using Web Search Manager. 


theme String Name of the theme (or directory within the templates directory) 
where a complete set of search and print templates are stored. 


Syntax: theme=theme_name 


Example: theme=Intranet 
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Name Value Description 
typequery_number Integer Type of search. 

0 = Normal search; this is the default. 

1 = Searches only the given document numbers. 

2 = Root search used by the search tree control to get the top 
tree nodes. 

3 = Used to get the children of the given document number. 

4 = Searches the descendants of the given document numbers 
and is used to narrow a search or a print request, including all 
of its children. 

Syntax: typequery_number=number 
Options: 

0 = Normal search; this is the default. 

1 = Searches only the given document numbers. 

2 = Root search used by the search tree control to retrieve the 
top tree nodes. 

3 = Retrieves the children of the given document number. 

4 = Searches the descendants of the given document numbers 
and is used to narrow a search or a print request, including all 
of its children. 

Example: type0=2 
Default: 0 (zero) 
url String Specified as a parameter to the Highlight servlet to determine the 
URL to highlight. The URL is highlighted only if the current user has 
rights to the file. The value must be properly URL-escaped. 
Syntax: url=value 
Example: url=http%3A%2F%2Fwww.novell.com%2Findex.html 
userid String User ID for form-based logins. 
Syntax: userid=variable 
Example: userid=jsmith 
weightquery_number Integer Assigns a level of importance to the current query item as far as it 


relates to the other query items that are part of the search query. 
Web Search Server uses this number along with the relevance 
number to determine a search result’s final relevance and then 
orders the results accordingly. 


Range: 0 to 100 

Syntax: weightquery_number=number 
Example: weight0=75 

Default: 100 
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Customizing Your Search Solutions 


You can quickly create a custom search solution by modifying the default NetWare® Web Search 
templates. Templates include some fundamental options for users, but you can add or remove 
options and modify the form layout and design to give the search form the look, feel, and function 
you need. If you are creating a hosted search service for another company’s Web site, you can 
modify the templates to match the look and feel of their Web site. 


If you are confident in coding with HTML, you can start with the default search page template to 
get a feel for the available parameters and then begin coding completely new search and print 
templates from scratch. 


This chapter includes the following topics: 
+ “Customizing Templates” on page 113 
¢ “Testing Your Search and Print Solution” on page 116 


+ “What's Next” on page 116 


Customizing Templates 


You can extend the capabilities of NetWare Web Search Server by customizing the templates. 


The first step is to determine which components of Web Search you want to customize. For 
example, if you only want to add a few additional search features to the search page template and 
modify its background color and table size, you would modify the SearchTemplate.html or 
SearchTemplate.Simple files. 


This section discusses how to customize the search, print, and result templates and how to use 
available parameters and variables to create a customized search solution. 


Customizing the Search Templates 


You can customize the design and functionality of the static or dynamic search templates by 
+ Modifying HTML code 
+ Adding or removing search parameters 
If you are familiar with HTML, you can quickly modify the design of the default (dynamic) search 


template or the static search template. For example, you can change the colors of the search page 
or add new custom graphics. 


To modify the functionality of the default search template, you can add or remove search 
parameters. Search parameters are used to communicate with NetWare Web Search. By 
embedding them in the correct places in your HTML source, you can extend or limit the 
functionality of the default search template. 
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For example, if you wanted your users to use a specific set of templates found in a themes 
directory, you would add the following HTML code, including the theme parameter, to the 
SearchTemplate.html file: 


<INPUT TYPE="Hidden" NAME="theme" VALUE="SSQueryTemplateTheme"> 


This sample HTML code tells Web Search to look for templates only in the specified template 
directory. All themes are located within the templates directory specified in Web Search Manager. 


For a complete list of available search parameters, see Table 11, “Search Parameters,” on 
page 103. 


Customizing Search Result Templates 


NetWare Web Search Server includes several default search result templates that are used to 
display hits, provide feedback to a user, or request information from a user after a search is 
performed. For more information about the default search result templates, see Chapter 7, 
“Understanding Templates,” on page 81. 


You can customize the design and functionality of the default search result template, the template 
used when a user selects Normal from the Result List Format drop-down list in the NetWare Web 
Search form. For information about how to access the NetWare Web Search form, see “Taking a 
Test Run: Performing a Search” on page 15. 


Customizing the default search result template involves 
+ Modifying the HTML code 


+ Adding or removing search result variables 


If you are familiar with HTML, you can quickly modify the design of the default search result 
template. For example, you can change the colors of the search page or add new graphics. 


To modify the functionality of the default search result template, you can add or remove search 
result variables. Search result variables are placed in the template where you want search results 
to be displayed. 


For example, if you wanted to display the total number of hits returned when a user performs a 
search and you wanted the information to appear in the upper-left corner of the search results page, 
you would add the following HTML code to the search result template file: 


Total Search Results: $$TotalHits 


After a user performs a search, the $$TotalHits variable would be replaced by the actual total 
number of hits found during the search. 


The $$TotalHits variable is used to retrieve the total number of hits found during a search. You can 
place this variable anywhere in the results list template to organize the display of information in 
the way you want. 


Default search result templates are located in volume:\searchroot\TEMPLATES\. For a complete 
list of search result variables that you can use to customize default search result templates or to 
create new ones, see Table 6, “Search Result Variables,” on page 96. 
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Customizing Print Result Templates 


NetWare Web Search Server includes two default print result templates: the default print result 
template and a "no hits" template. Print result templates are used to organize and format search 
results for printing and to provide feedback to a user when no hits are found. For more information 
about the default print result templates, see Chapter 7, “Understanding Templates,” on page 81. 


You can customize the design and functionality of the default print result template in the same way 
you customize the search result template by 


+ Modifying the HTML code 


+ Adding or removing print result variables 


If you are familiar with HTML, you can quickly modify the design of the default print result 
template. For example, you can change the colors of the print results page or add new graphics to it. 


To modify the functionality of the default print results template, you can add or remove print result 
variables. Variables are placed in the template where you want search results to be displayed. 


For example, if you wanted to remove the table of contents from the default print results template, 
you would remove, or comment out, the following HTML code in the 
PRINTRESULTLIST.HTML template, which would include the $$BeginTOCList variable: 


<CENTER><H2>Table of Contents</H2></CENTER><p><! == TABLE OF CONTENTS 
——>$$BeginTOCLi st [<BIG><B>$$Product</B></BIG><DL>]<DT><A 
HREF="+$$Bookmark"><BIG>$$Title</BIG></A><SPACER TYPE=HORIZONTAL 
SIZE=20><I><SMALL> [$$URL] </ SMALL></I>$S$EndTOCList [</DL>] 


You could either save your changes in the default print result list template or you could save it 

using a new name, thereby creating an alternative template for users who don’t want a table of 
contents in the print results. To be effective, you would then have to add a hypertext link in the 
search result template that would include the &template=new_template_name query parameter. 


Default print result templates can be found at volume:\searchroot\templates. For a complete list of 
print result variables that you can use to customize default search result templates or to create new 
ones, see Table 7, “Print Result Variables,” on page 99. 


Customizing Error and Response Message Templates 


Error and response messages are used to either provide feedback to the user or to request 
information from the user. 


Error and response message templates are used to display the content of error and response 
messages sent by the Web Search Server in response to search or print errors. Similar to search and 
print templates, error and response templates can be customized. However, because the contents 
of error and response messages are built into NetWare Web Search Server, you cannot modify the 
contents of the messages or the button objects that might appear, depending on the type of response 
being generated. 


Customizing Error Messages 


There are several error messages that can be returned to a user. For example, when users 
incorrectly use a search operator in a search form, they might get the message, "Search Error: 
Incorrect use of Boolean operator." An error number might also appear. 
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While you can utilize HTML tags to format an error message, add or remove variables to 
determine what information is shown to the user, or even reorganize where the messages will 
appear in the template, you cannot modify the message itself. 


Customizing Response Messages 


The same concepts apply to response messages, but response messages return buttons that a user 
can click. Which buttons appear are determined by the NetWare Web Search Server. While you 
can modify the labels of these buttons, you cannot determine which buttons will appear, or when. 


Testing Your Search and Print Solution 


Once you’ve completed customizing the templates and the search form, you can test them in your 
Web browser by pointing to the search form URL and entering a search string. See “Taking a Test 
Run: Performing a Search” on page 15 for information about how to access the NetWare Web 
Search form. 


TIP: Remember that a search cannot be performed until you have defined at least one index and generated 
it using NetWare Web Search Manager. Refer to Web Search Manger’s online Help for the steps required in 
defining and generating an index. Also, see Chapter 6, “Creating and Managing Virtual Search Servers,” on 
page 57 for an overview of indexes. 


What’s Next 


For more information about the necessary components for building a solution from scratch, see 
Chapter 7, “Understanding Templates,” on page 81 and Chapter 8, “Working with Template 
Variables and Search Parameters,” on page 87. 
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Internationalizing Search Services 


NetWare® Web Search Server is capable of handling search queries, search results, templates, and 
Web content in many languages and character sets. Web Search can auto-detect languages and 
character sets, but to ensure a complete international search solution, you must identify language, 
country, and character information throughout your Web Search implementation. 


This chapter discusses key issues related to supporting multiple languages from a single search 
solution and includes the following topics: 


+ “Working with Multiple Languages” on page 117 

+ “Understanding Character Set Encodings” on page 119 

+ “Languages Included in the Default Templates” on page 122 
+ “What's Next” on page 123 


Working with Multiple Languages 


Customizing your search solution is important only if you want to let your users conduct language- 
specific searches. You specify the language of a template by inserting a language identifier in the 
META tag of your templates or HTML files. The language identifier can also be used in Search 
Results pages to let users quickly recognize the search results that interest them. 


NetWare Web Search Server also lets Web clients specify their locale at the time the search query 
is entered. The default Search page illustrates this feature by auto-detecting a user's locale and 
selecting the appropriate language from the Display Language drop-down list. This selection sends 
two parameters to the Web Search Server: language and country. The country parameter is almost 
always blank. The search engine uses this information to find locale-specific versions of the 
templates used to return search results. 


To specify the language of a template or of any HTML content that gets indexed as part of your 
virtual search server, you must enter a language identifier within an HTML file’s header section. 
For example, if you wanted to identify a Russian template, you would add the following META 
tag: 


<meta http-equiv="Content-Language" content="ru"> 


In some cases, such as Traditional and Simplified Chinese, you will need to use the two-character, 
uppercase country codes. For example: 


<meta http-equiv="Content-Language" content="zh-TW"><meta http- 
quiv="Content-Language" content="zh-CN"> 


The first line of the example indicates the Chinese language (ZH) and the geographic location as 
Taiwan. The second line of the example indicates the Chinese language (ZH) but China as the 
geographic location. 


This combination of language and country codes is called a locale. For more information about 
locales, refer to Table 12 on page 123. 
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Specifying Locales within Template Filenames 


NetWare Web Search Server consists of three primary servlets: SearchServlet, PrintServlet, and 
AdminServlet. Each servlet returns information to the Web client using server-side templates. 
Templates are stored on at volume:\searchroot\TEMPLATES. For more information about 
templates, see Chapter 7, “Understanding Templates,” on page 81. 


After determining a Web client’s locale, Web Search attempts to locate a matching search result 
template. That is, each of the Web Search services automatically attempts to locate a version of the 
requested template that most closely matches the Web client’s locale. 


IMPORTANT: NetWare Web Search cannot find locale-specific templates without the two-character language 
code and the optional two-character country code. See Table 12 on page 123 for more information about 
language code syntax. 


For example, if a Web client requests to see search results using the ResultListTemplate.html file 
and the client is a Chinese language user from Taiwan and the server is Russian, then Web Search 
will try to find a Chinese-Taiwan version of the template first (ResultListTemplate_zh_TW.html) 
because that exactly matches the client's language and country. The following table lists the 
template names the system would look up in this example in order of priority. 


Template Name What Web Search Concludes 


1. ResultListTemplate_zh_TW.html Specific client locale 


2, ResultListTemplate_zh.html Simplified client locale 

3. ResultListTemplate.html Client requested name 

4. ResultListTemplate_ru.html Specific server locale (no simplified versions) 
5. ResultListTemplate_en.html English language version 


6. ResultListTemplate.html Up to the first underscore ( _ ) 


If this scenario were reversed so that the search client was Russian and the server was Chinese 
(Taiwan), and the client requested the ResultListTemplate_ja.html template, then the lookup order 
would follow the order shown in the following table. 


Template Name What Web Search Concludes 

1. ResultListTemplate_ja_ru.html Specific client locale (no simplified versions) 
2. ResultListTemplate_ja.html Client requested name 

3. ResultListTemplate_ja_zh_TW.html Specific server locale 

4. ResultListTtemplate_ja_zh.html Simplified server locale 

5. ResultListTemplate_ja_en.html English language version 


6. ResultListTemplate.html Up to the first underscore ( _ ) 


All templates undergo this rigorous lookup system. Once a template is located, its name is stored 
and associated with the original client locale so that all subsequent requests for that template from 
the same locale automatically find the template without performing the same rigorous lookup. 
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No further lookups are attempted for that combination of client locale and template name until the 
NetWare Web Search Server is restarted. If all template lookups fail, then an error message is 
returned to the client performing the search. 


Understanding Character Set Encodings 


A character set is a grouping of alphabetic, numeric, and other characters that have some 
relationship in common. For example, the standard ASCII character set includes letters, numbers, 
symbols, and control codes that make up the ASCII coding scheme.A character set encoding is 
the mapping of a character set to a value that can be understood and processed by a computer. 


NetWare Web Search relies on character set encodings to identify the characters used when 
performing a search, reading a template, posting results to a Web browser, or indexing Web-based 
content. If the encoding information is missing in any of these areas, NetWare Web Search uses 
the default encodings identified in the SearchServlet and PrintServlet properties files. You can 
modify these settings using NetWare Web Search Manager. 


Because most languages have several encodings that their character sets are identified by, NetWare 
Web Search Server supports a wide variety of character set encodings and encoding aliases. 


Some examples of character set encodings include iso-8859-1, shift_jis, big5, and latin2. The 
official list of registered encodings is available from the Internet Assigned Numbers Authority (see 
Table 12 on page 123). These are the official names for character sets that can be used in the 
Internet and can be referred to in Internet documentation. However, not all IANA-registered 
character set encodings are supported by NetWare Web Search Server. Refer to Table 12 on 
page 123 for a list of encodings and encoding aliases that are supported by NetWare Web Search 
Server. 


Unicode and UTF8 


Unicode* is a 16-bit character encoding standard developed by the Unicode Consortium. By using 
two bytes to represent each character, Unicode enables almost all of the written languages of the 
world to be represented using a single character set. Unicode does not require any special 
processing to access any character in any language. 


This makes Unicode very easy to use when processing text from multiple languages and scripts. 
This is the reason NetWare Web Search converts all external files into Unicode for processing. 


As already mentioned, Unicode is two bytes wide for all characters. Although this is ideal for 
computer processing, it doubles the size of all single-byte languages. This has a significant impact 
on Internet performance. For this reason, NetWare Web Search also supports an alternate 
representation of Unicode known as UTF-8. UTF-8 is a Unicode Transformation Format that uses 
sequences of | to 6 bytes to represent all the characters in the Unicode standard. Most notably, 
ASCII characters are transmitted without any conversion at all. This means that most Internet 
content is already in the UTF-8 representation. Many Asian languages, however, require three 
bytes per character in the UTF-8 format. Other languages can require up to six bytes to represent 
each of their characters. 


You will have to decide if Unicode or UTF-8 best meets your needs when creating HTML content, 
Web Search templates, or search pages. 
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Search Encodings 


The only encodings NetWare Web Search currently supports when performing a search are 
Unicode and UTF-8. Therefore, any page that allows Web users to enter a search must ensure that 
the results are passed to the server in one of these two formats. See “Template Encodings” on 
page 121 for more information. 


To pass Unicode characters to NetWare Web Search, use the syntax %uHHHH, where 
+ Percent sign (%) is used as the CGI escape character 
+ Lowercase letter U (u) indicate that the subsequent 4 characters represent a Unicode value. 
+ Four uppercase H letters (HHHH) indicate four hexadecimal characters (0-9, A-F) 


To pass UTF-8 characters to NetWare Web Search, just use normal ASCII characters or the syntax 
%HH... for all other characters, where 


+ % is the CGI escape character 
+ HH indicates two he xi decimal characters (0-9, A-F) 


+ %HH indicates additional %HH groupings that might be required to properly transmit a 
character 


TIP: If the encoding of the page containing a search form is already set to UTF-8 or Unicode, most browsers 
automatically transmit the entered search text correctly using the designated encoding. 


By default, NetWare Web Search uses UTF-8 in its sample search pages. 


Response Encodings 


One of the many parameters that can be sent when conducting a search is the encoding that should 
be used when returning the results back to the browser. All NetWare Web Search encodings listed 
in Appendix B, “Combined Character Sets for Use with NetWare Web Search,” on page 127 can 
be used. 


If the search result page contains the ability to refine or redo the search, then the response encoding 
can significantly impact the possible characters that can be entered when conducting the next 
search from this page. For example, if the user requests results in the iso-8859-1 encoding 
(HTML's default), then only iso-8859-1 characters can be entered in the subsequent search from 
that page. Other characters can still be sent to the Web Search services using the %uHHHH and 
%HH formats, but the browser will not allow users to enter normal text characters other than that 
supported by iso-8859-1. 


Although Web Search can return search results from many languages, some characters found in 
titles and descriptions might be returned as question marks (?) indicating that these characters are 
not available in the current response encoding. If a character can be represented in the current 
encoding but a font is not available, many browsers will substitute an alternate character such as 
an empty box character. Once the appropriate fonts have been installed, these characters will then 
display properly. 


By default, NetWare Web Search returns all search, print, and administration pages in UTF-8. 
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HTML Encodings 


Since HTML content can contain text written in many character sets, all HTML files need to 
include a tag that identifies the character set encoding. To identify the encoding of an HTML file 
(or search template), use the following META tag at the top of the file's header section: 


<meta http-equiv="Content-Type" content="text/html; charset=Shift_JIS"> 


In this example, you would replace Shift_JIS with the appropriate Internet Assigned Numbers 
Authority (IANA)-assigned encoding value. 


It is very important that the CHARSET value accurately represent the character set encoding that 
was actually used when the HTML Web content or Web Search template was created. A correct 
entry allows Web Search to accurately interpret and convert the characters in the document. An 
incorrect entry prevents Web Search from being able to read the characters as valid data in the 
authored language. 


IMPORTANT: Improperly identified characters result in garbled text. In some cases, the Web-based content 
cannot be properly indexed or printed. In the most severe cases, the document being read might produce a 
server-side exception, which will ultimately discontinue processing the document and perhaps the entire 
current operation. 


Because Web Search is Unicode-based, when reading templates or when indexing or printing 
HTML content, all character encodings are converted from their source encoding to Unicode for 
internal processing. 


During indexing, if a document contains characters not supported by the designated encoding, if 
the document doesn't have an encoding designation, or if the designation is inaccurate, the indexer 
will do its best to recover. But if it cannot, it might index the information incorrectly or quit 
indexing that page entirely. 


When reading a template file, Web Search might automatically cease processing the file if it 
contains any characters not supported by the current encoding. It will try to ignore the invalid text 
and continue, but this might not be possible. 


When displaying search results or when printing HTML content, any character that does not match 
the specified response encoding will receive a question mark (?) in its place when rendered at the 
browser. Although some characters are properly supported by the current encoding, the browser 
might not have the required fonts to display the characters. In this case, users might see square 
boxes representing these characters. This is an indication that the valid character reached the 
browser, but the operating system could not provide a font to properly render the character. The 
user would than have to either change fonts or install the correct fonts in order to properly display 
the characters. 


TIP: If a document does not contain a CHARSET encoding value, the default encoding for HTML documents 
is ISO-8859-1, also known as Latin1. The default encoding for plain text documents is US-ASCII. 


Web Search also allows administrators to define the default encodings for templates, HTML 
content when printing, and search and print responses. Refer to the NetWare Web Manager Help 
for information about changing the default encodings. 


Template Encodings 


All HTML documents should include a Content-Type META tag identifying their character set 
encodings. The character set encoding allows HTML Web clients (or browsers) to understand the 
contents of the file. This tag is also used by browsers to automatically switch their display system 
and fonts to correctly show the Web page's contents. This lets users surf the World Wide Web 
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without having to constantly change their display system as they encounter content from various 
languages and characters sets. 


However, because NetWare Web Search lets administrator specify both template encodings and 
response encodings, browsers might get confused when presented with the valid response 
encoding in the HTTP header and one or more alternate encodings from the Content-Type META 
tags within the file that was part of the original Web Search template. 


NOTE: $$IncludeFile[ ] templates can also contain their own Content-Type meta tags. 


To solve this problem, NetWare Web Search allows placing the Content-Type META tag 
specifying the template's encoding within an HTML comment. This effectively obscures the 
original template encoding from the browser, but still allows Web Search to read the encoding 
when the template file is processed. 


A sample Web Search template is illustrated below. The Content-Type META tag has been hidden 
inside of an HTML comment. This template can be embedded within other templates using the 
$$IncludeFile[ ] template variable without affecting Web Search's ability to distinguish between 
the various encodings. This file can also be processed and then sent to a user's Web browser 
without conflicting with the response encoding provided by Web Search in the HTTP response 


headers. 

<html> 

<head><!-- Note that the HTML encoding command (meta tag) is hidden within a 
comment so that it does not affect a user's browser display. --><!-- The 
actual encoding used when sending this file to the user is controlled by the 
response encoding --><!-- <META HTTP-EQUIV="Content-Type" CONTENT="text/ 
html; charset=iso-8859-1"> ></head> 

<body> 


Template data here.</body> 
</html> 


Encoding Issues When Printing 


When NetWare Web Search processes a print request, it gathers the entire contents of each file and 
builds an appended print job page, one file after another. Each file can contain its own Content- 
Type META tag identifying its encoding. Each file's encoding will be used by Web Search to 
convert that file into Unicode before being sent out using the response encoding. 


Unfortunately, all of these encoding META tags might confuse the browser's display system. 
While Web Search has already properly converted the files into a single response encoding, the 
browser sees the Content-Type META tags which direct it to do something else, and gets confused. 


The way to solve this problem is to create a print results template that contains a Content-Type 
META tag encoding at both the top and bottom of the file, before and after the various documents 
get printed. All current browsers take either the first Content-Type META tag that they encounter 
or the last. Constructing a print template with both satisfies all browsers. 


Languages Included in the Default Templates 


There are additional search and print templates for each of the following languages: 
+ Chinese (Traditional and Simplified) 
+ English 


+ French 
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+ German 

+ Italian 

+ Japanese 
+ Korean 

+ Portuguese 
+ Russian 


+ Spanish 


Templates are stored at volume searchrooN TEMPLATES. 


What's Next 


The following table lists additional resources for learning more about locales, country and 
language codes, and encodings. 


Table 12 Additional Information Resources 


Component 


Language and country 
codes (locale) 


Resource Location 


RFC1766 (http://www.ietf.org/rfc/rfc1766.txt) 


NOTE: While RFC1766 uses the hyphen character ( - ) to separate 
language and country information, Web Search uses the underscore 
character ( _ ) in order to conform to the Java convention. 


150639 (http://www.ics.uci.edu/pub/ietf/http/related/iso639.txt) 
1503166 (http:/Awww.chemie.fu-berlin.de/diverse/doc/ISO_3166.html) 


Character sets 


Internet Assigned Numbers Authority (IANA) Character Set registry 
(http:/Awww.iana.org/assignments/character-sets) 


Unicode 


Unicode Consortium home page (http://www.unicode.org) 


UTF-8 


UTF-8: A Transformation Format of 15010646" (http://nis.nsf.net/ 
internet/documents/rfc/rfc2279.txt) 
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Troubleshooting NetWare Web Search 


This appendix provides some troubleshooting topics that can help you resolve search and print 
performance issues. 


Troubleshooting 


The following sections offer possible causes for issues you might encounter, as well as suggested 
actions for resolving them. 


Characters of descriptions or titles appear as intelligible characters 


Possible Cause: 


Possible Cause: 


Action: 


You've probably indexed documents written in multiple languages and encodings. Web Search can 
index most of the world’s languages and encodings. However, Web Search needs to know the 
encoding of each document. 


Some of your documents were probably not tagged with an encoding or were incorrectly tagged. 


Make sure all of your documents contain the correct Content-Type META tag. If your international 
documents do not contain a Content-Type META tag, either add it or use the Encoding (If Not in 
META Tags) index definition option to specify the default encoding. 


Several titles or descriptions contain the same text 


Possible Cause: 


Action: 


Possible Cause: 


Action: 


If search results include duplicate titles or descriptions, your description fields (description, 
summary, or abstract) might include boilerplate information. 


The more accurate your META tag description fields are, the better your search results will be. 
Where possible, consider adding descriptions to your document’s META tags. 


It could also be that you have indexed the same document more than once, or several links 
throughout your Web site might point to the same document but do so using different character 
cases each time. 


To solve the latter problem, try using the URLs Are Case Sensitive option to direct Web Search to 
turn off case-sensitive crawling. Also, remove any duplicate backup files you might have and 
exclude any backup directories from your index definition. 


Some titles are returned as the URL of the document instead 


Possible Cause: 


Action: 


Web Search pulls document titles from within each document that it indexes. If your document 
doesn't have a title, Web Search uses the URL or path of the document instead. If the URL is 
unavailable, a Title Unavailable message is returned. 


Make sure all of the documents you index have specifically defined titles. 
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Additional Assistance 


If the problem you are working with doesn’t appear in this appendix, visit the Novell® Support 
Connection Web site (http://support.novell.com). 
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Combined Character Sets for Use with NetWare 
Web Search 


The following tables list the character set encoding names and aliases that Web Search recognizes 
when indexing, searching, displaying, or printing files. This information is a subset of the character 
names registered by the Internet Assigned Numbers Authority (IANA). 


Whenever possible, the items listed in the first column of each table are the preferred MIME names 
listed in the Internet Assigned Numbers Authority (IANA) Character Sets registry. If a preferred 
MIME name is not available, items in the first column represent the primary registered names. 


Items in the second column of each table are aliases which are also at times used to identify that 
encoding. 


Note that not all aliases exactly represent the parent encoding under which they are listed. In these 
cases, they overlap significantly enough that they will be handled identically by the various 
NetWare® Web Search engines. 


TIP: Character encodings appear in the exact case specified in the Internet Assigned Numbers Authority 
(IANA) Character Sets registry. Some uses of these encodings are case sensitive. However, NetWare Web 
Search ignores the case of these encodings. 
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ASCII Character Set 


Preferred MIME Name or Primary Registered Name Encoding Names 
US-ASCII (MIBenum: 3)* ANSI_X3.4-1968 
ANSI_X3.4-1986 
ASCII 
ascii7 
iso_646-us 
150646-US 
ISO_646.irv:1991 
iso-ir-6 
646 
us 
IBM367 
cp367 
csASCII 


IBM437 (MIBenum: 2011) ibm-437 
cp437 
437 
csPC8CodePage437 


* A MIBenum is a record number corresponding to an entry in IANA’s Management Information 
Base. 
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Arabic Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 

ISO-8859-6 (MIBenum: 9) ISO_8859-6:1987 
ISO_8859-6 
iso8859-6 
iso8859_6 
8859_6 
IBM1089 
ibm-1089 
cp1089 
1089 
iso-ir-127 
ECMA-114 
ASMO-708 
arabic 


csISOLatinArabic 


Windows-1256 (MIBenum: 2256) cp1256 
win1256 
ms1256 


Chinese (Simplified) Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 


gb2312 (MIBenum: 2025) csGB2312 
gb_2312-80 (MIBenum: 57) iso-ir-58 
chinese 


csISO58GB231280 
gb2312-80 
gb2312-1980 
gb-2312-80 


Combined Character Sets for Use with NetWare Web Search 


129 


Preferred MIME Name or Primary Registered Name 


Encoding Aliases 


gbk 


GBK 
windows-936 
ms936 
cp936 
cp-936 


euc-cn 


Chinese (Traditional) Character Set 


Preferred MIME Name or Primary Registered Name 


big5 (MIBenum: 2026) 


EUC_CN 
euccn 


euc-gb 


Encoding Aliases 
Big5 
windows-950 
win950 

ms950 


csBig5 


IBM950 
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ibm-950 
cp950 
cp-950 
950 


Cyrillic Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 
ISO-8859-5 (MIBenum: 8) ISO_8859-5:1988 
ISO_8859-5 
iso8859-5 
iso8859_5 
8859-5 
iso-ir-144 
IBM915 
ibm-915 
cp915 
915 
cyrillic 


cslSOLatinCyrillic 


KOI8-R (MIBenum: 2084) koi8_r 
koi8 
cp878 
cp-878 
csKOI8R 


Windows-1251 (MIBenum: 2251) win1251 
cp1251 
ms1251 


European Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 
Windows-1252 (MIBenum: 2252) cp1252 
ms1252 
win1252 
ansi 


ansi-1252 
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Preferred MIME Name or Primary Registered Name Encoding Aliases 


ISO-8859-1 (MIBenum: 4) ISO_8859-1:1987 
ISO_ 8859-1 
iso8859-1 
iso8859_1 
8859_1 
iso-ir-100 
IBM819 
ibm-819 
CP819 
819 
11 
latin1 


csISOLatin1 


ISO-8859-2 (MIBenum: 5) ISO_8859-2:1987 
ISO_8859-2 
iso8859-2 
iso8859_2 
8859 2 
iso-ir-101 
IBM912 
ibm-912 
cp912 
912 
12 
latin2 


csISOLatin2 
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Preferred MIME Name or Primary Registered Name Encoding Aliases 


ISO-8859-3 (MIBenum: 6) 


ISO_8859-3:1988 
ISO_8859-3 
iso8859-3 
iso8859_3 
8859-3 
iso-ir-109 
IBM913 
ibm-913 
cp913 

913 

13 

latin3 


csISOLatin3 


ISO-8859-4 (MIBenum: 7) 


ISO_8859-4:1988 
ISO_ 8859-4 
iso8859-4 
iso8859_4 
8859-4 
iso-ir-110 
IBM914 
ibm-914 
cp914 

914 

14 

latin4 


csISOLatin4 


Windows-1250 (MIBenum: 2250) 


cp1250 
ms1250 
win1250 


IBM850 (MIBenum: 2009) (UNICODE) 


ibm-850 

cp850 

850 
csPC850Multilingual 
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Preferred MIME Name or Primary Registered Name 


Encoding Aliases 


IBM852 (MIBenum: 2010) 


ibm-852 
cp852 
852 
csPCp852 


IBM860 (MIBenum: 2048) 


ibm-860 
cp860 
860 
csIBM860 


IBM863 (MIBenum: 2050) 


ibm-863 
cp863 
863 
csIBM863 


IBM865 (MIBenum: 2052) 
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ibm-865 
cp865 
865 
csIBM865 


Greek Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 
ISO-8859-7 (MIBenum: 10) ISO_8859-7:1987 
ISO_8859-7 
iso8859-7 
8859 _7 
IBM813 
ibm-813 
cp813 
813 
iso-ir-126 
ELOT_928 
ECMA-118 
greek 
greek8 
csISOLatinGreek 


Windows-1253 (MIBenum: 2253) cp 1253 
ms1253 
win1253 
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Hebrew Character Set 


Preferred MIME Name or Primary Registered Name 


ISO-8859-8 (MIBenum: 11) 


Encoding Aliases 
ISO_8859-8:1988 
ISO_8859-8 
iso8859-8 
8859 _ 8 

ibm916 

ibm-916 

cp916 

916 

iso-ir-138 
hebrew 


csISOLatinHebrew 


Windows-1255 (MIBenum: 2255) 


Japanese Character Set 


Preferred MIME Name or Primary Registered Name 


ISO-2022-JP (MIBenum: 39) 


win1255 
cp1255 
ms1255 


Encoding Aliases 
iso2022-jp 
iso-2022-jis 


junet 


jis_encoding 
csJISEncoding 
csISO2022JP 


ISO-2022-JP-2 (MIBenum: 40) 


iso-2022-jp2 
csISO2022JP2 
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Preferred MIME Name or Primary Registered Name Encoding Aliases 


Shift_JIS (MIBenum: 17/2024) sjis 
shift-jis 
ShiftJis 
x-sjis 
x-shift-jis 
windows-31j 
csWindows31J 
ms932 
cp932 
win932 
windows-932 
MS_Kanji 
csShiftJIS 


pck 


\u30b7\u30d5\u30c8\u7b26\u53f7\u531 6\u8868\u 


73fe 


EUC-JP (MIBenum: 18) Extended_UNIX_Code_Packed_Format_for_Jap 


anese 
eucjp 

x-euc-jp 

euc_jpnew 10/18/99 
x-eucjp 

eucjis 


csEUCPkdFmtJapanese 


Korean Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 
euc-kr (MIBenum: 38) euc_kr 
euckr 


csEUCKR 


Combined Character Sets for Use with NetWare Web Search 


137 


Preferred MIME Name or Primary Registered Name 


Encoding Aliases 


ks_c_5601-1987 (MIBenum: 36) 


ks_c_ 5601-1989 
ksc5601-1987 
ksc5601_ 1987 
ksc_5601 
ksc5601 

5601 

korean 


csKSC56011987 


IBM949 


ibm-949 
cp949 
cp-949 
949 


Windows-949 


Thai Character Set 


Preferred MIME Name or Primary Registered Name 


win949 
ms949 


Ecoding Aliases 


IBM874 ibm-874 
cp874 
874 

Windows-874 win874 
ms874 
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Turkish Character Set 


Preferred MIME Name or Primary Registered Name Encoding Aliases 
ISO-8859-9 (MIBenum: 12) ISO_8859-9:1989 
ISO_8859-9 
iso8859-9 
8859_9 
ibm920 
ibm-920 
cp920 
920 
iso-ir-148 
15 
latin5 


csISOLatin5 


Windows-1254 (MIBenum: 2254) win1254 
cp1254 
ms1254 


Vietnamese Character Set 


Preferred MIME Name or Primary Registered Name Ecoding Aliases 

Windows-1258 (MIBenum: 2258) win1258 
ms1258 
cp1258 
cp-1258 
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